Closed Bug 1524114 Opened 9 months ago Closed 6 months ago

Run xpcshell-test using generic-worker on Windows/aarch64

Categories

(Testing :: General, task, P3)

ARM64
Windows
task

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: egao, Assigned: egao)

References

(Depends on 4 open bugs)

Details

Now that generic-worker has been proven to run on win64/aarch64, make it run the xpcshell-test suite.

Record the outcomes and/or issues that occur.

Assignee: nobody → egao
Status: NEW → ASSIGNED

A test run has been completed using taskcluster generic-worker for xpcshell-test suite.

The build of windows-aarch64 used is DdbhnS_zRmiRXF5yh8UBiA with the following section of code commented out as it was causing premature failures prior to tests running:

https://searchfox.org/mozilla-central/source/testing/mozharness/configs/unittests/win_taskcluster_unittest.py#231

Test Run

e5ppB_agTXiCQ_Q4MknwWA

Result

Test reached maxRunTime value in task definition of 3000s. Test was aborted mid-way.

The duration of test is extremely long compared to locally executed instances done as part of 1520867, recorded at Google Sheets, cell G49.

Log analysis for the aborted run:

  • task_start: 15:08:24
  • suite_tart: 15:17:40
  • aborted: 15:58:28

A quick and dirty comparison between the locally executed instance and the taskcluster executed instance, with dom/push/test/xpcshell/test_register_5xxCode_http2.js taken as a sample:

locally executed: 21 tests/actions executed
taskcluster executed: 7 tests/actions executed

locally executed:

15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-ulcvxa',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  TEST-PASS | dom/tests/unit/test_geolocation_timeout.js | took 4297ms
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-ikborq',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-iympky',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  TEST-PASS | extensions/cookie/test/unit/test_cookies_profile_close.js | took 2828ms
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-qrygyn',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-ulcvxa',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-qysbsd',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-fkrmhi',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  TEST-START | extensions/cookie/test/unit/test_cookies_thirdparty.js
15:29:07     INFO -  Failed to remove directory: c:\users\edwin\appdata\local\temp\xpc-plugins-_cp3st. Waiting.
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-27efae',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  Failed to remove directory: c:\users\edwin\appdata\local\temp\xpc-plugins-jnjhki. Waiting.
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-sbenqm',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-qrygyn',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-ex8ftz',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  TEST-PASS | dom/push/test/xpcshell/test_register_5xxCode_http2.js | took 20572ms
15:29:07     INFO -  TEST-PASS | dom/push/test/xpcshell/test_resubscribe_listening_for_msg_error_http2.js | took 20588ms
15:29:07     INFO -  TEST-PASS | extensions/cookie/test/unit/test_bug650522.js | took 3969ms

taskcluster executed:

15:23:29     INFO -  TEST-START | dom/push/test/xpcshell/test_resubscribe_listening_for_msg_error_http2.js
15:23:29     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-bcfost',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:23:29     INFO -  TEST-START | dom/push/test/xpcshell/test_register_5xxCode_http2.js
15:23:29     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-0wfkl5',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:23:29     INFO -  TEST-START | dom/push/test/xpcshell/test_updateRecordNoEncryptionKeys_http2.js
15:23:29     INFO -  Failed to remove directory: c:\users\edwin\appdata\local\temp\xpc-plugins-nyanyh. Waiting.
15:23:29     INFO -  TEST-START | dom/quota/test/unit/test_basics.js

This is not a scientific analysis but shows that something is causing the taskcluster executed instance to execute far slower than locally executed instance.

Another test run has been completed, this time the full test run.

Result

KDASFNUESniU9f8jFVUd0A

17:42:16     INFO -  INFO | Result summary:
17:42:16     INFO -  INFO | Passed: 3170
17:42:16  WARNING -  INFO | Failed: 77
17:42:16  WARNING -  One or more unittests failed.
17:42:16     INFO -  INFO | Todo: 4
17:42:16     INFO -  INFO | Retried: 90
17:42:16     INFO -  SUITE-END | took 4774s

Some changes to the task definition was made and xpcshell test run again with the following results:

Result

DKrfvcXxQ3W9dfC7XTFr7Q

11:13:37     INFO -  INFO | Result summary:
11:13:37     INFO -  INFO | Passed: 3171
11:13:37  WARNING -  INFO | Failed: 76
11:13:37  WARNING -  One or more unittests failed.
11:13:37     INFO -  INFO | Todo: 4
11:13:37     INFO -  INFO | Retried: 88
11:13:37     INFO -  SUITE-END | took 4631s

Summary: Run xpcshell-test using generic-worker on aarch64 → Run xpcshell-test using generic-worker on Windows/aarch64
Depends on: 1524731
Blocks: 1525118
No longer blocks: 1525118
Depends on: 1525378
Depends on: 1525415
Depends on: 1525416
Depends on: 1525417
Depends on: 1525785
Priority: -- → P3
Depends on: 1530752
Depends on: 1530759
Depends on: 1530841
Depends on: 1530870
Depends on: 1530871
Depends on: 1532801
Depends on: 1532804
Depends on: 1532854
Depends on: 1535475
Depends on: 1535476
Depends on: 1535477
Depends on: 1536217
No longer depends on: 1536217
Depends on: 1536221
Depends on: 1547412
Status: ASSIGNED → RESOLVED
Type: enhancement → task
Closed: 6 months ago
OS: Unspecified → Windows
Hardware: Unspecified → ARM64
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.