1524114 - Run xpcshell-test using generic-worker on Windows/aarch64

Status: RESOLVED FIXED

(Testing :: General, task, P3)

Description

[Edwin Takahashi (:egao | infrequent contributor)]

Now that generic-worker has been proven to run on win64/aarch64, make it run the xpcshell-test suite.

Record the outcomes and/or issues that occur.

Comment 1

[Edwin Takahashi (:egao | infrequent contributor)]

A test run has been completed using taskcluster generic-worker for xpcshell-test suite.

The build of windows-aarch64 used is DdbhnS_zRmiRXF5yh8UBiA with the following section of code commented out as it was causing premature failures prior to tests running:

https://searchfox.org/mozilla-central/source/testing/mozharness/configs/unittests/win_taskcluster_unittest.py#231

Test Run

e5ppB_agTXiCQ_Q4MknwWA

Result

Test reached maxRunTime value in task definition of 3000s. Test was aborted mid-way.

The duration of test is extremely long compared to locally executed instances done as part of 1520867, recorded at Google Sheets, cell G49.

Log analysis for the aborted run:

• task_start: 15:08:24
• suite_tart: 15:17:40
• aborted: 15:58:28

A quick and dirty comparison between the locally executed instance and the taskcluster executed instance, with dom/push/test/xpcshell/test_register_5xxCode_http2.js taken as a sample:

locally executed: 21 tests/actions executed
taskcluster executed: 7 tests/actions executed

locally executed:

15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-ulcvxa',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  TEST-PASS | dom/tests/unit/test_geolocation_timeout.js | took 4297ms
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-ikborq',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-iympky',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  TEST-PASS | extensions/cookie/test/unit/test_cookies_profile_close.js | took 2828ms
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-qrygyn',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-ulcvxa',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-qysbsd',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-fkrmhi',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  TEST-START | extensions/cookie/test/unit/test_cookies_thirdparty.js
15:29:07     INFO -  Failed to remove directory: c:\users\edwin\appdata\local\temp\xpc-plugins-_cp3st. Waiting.
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-27efae',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  Failed to remove directory: c:\users\edwin\appdata\local\temp\xpc-plugins-jnjhki. Waiting.
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-sbenqm',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-qrygyn',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-ex8ftz',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:29:07     INFO -  TEST-PASS | dom/push/test/xpcshell/test_register_5xxCode_http2.js | took 20572ms
15:29:07     INFO -  TEST-PASS | dom/push/test/xpcshell/test_resubscribe_listening_for_msg_error_http2.js | took 20588ms
15:29:07     INFO -  TEST-PASS | extensions/cookie/test/unit/test_bug650522.js | took 3969ms

taskcluster executed:

15:23:29     INFO -  TEST-START | dom/push/test/xpcshell/test_resubscribe_listening_for_msg_error_http2.js
15:23:29     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-bcfost',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:23:29     INFO -  TEST-START | dom/push/test/xpcshell/test_register_5xxCode_http2.js
15:23:29     INFO -  rmtree() failed for "('c:\\users\\edwin\\appdata\\local\\temp\\xpc-plugins-0wfkl5',)". Reason: The process cannot access the file because it is being used by another process (13). Retrying...
15:23:29     INFO -  TEST-START | dom/push/test/xpcshell/test_updateRecordNoEncryptionKeys_http2.js
15:23:29     INFO -  Failed to remove directory: c:\users\edwin\appdata\local\temp\xpc-plugins-nyanyh. Waiting.
15:23:29     INFO -  TEST-START | dom/quota/test/unit/test_basics.js

This is not a scientific analysis but shows that something is causing the taskcluster executed instance to execute far slower than locally executed instance.

Comment 2

[Edwin Takahashi (:egao | infrequent contributor)]

Another test run has been completed, this time the full test run.

Result

KDASFNUESniU9f8jFVUd0A

17:42:16     INFO -  INFO | Result summary:
17:42:16     INFO -  INFO | Passed: 3170
17:42:16  WARNING -  INFO | Failed: 77
17:42:16  WARNING -  One or more unittests failed.
17:42:16     INFO -  INFO | Todo: 4
17:42:16     INFO -  INFO | Retried: 90
17:42:16     INFO -  SUITE-END | took 4774s

Comment 3

[Edwin Takahashi (:egao | infrequent contributor)]

Some changes to the task definition was made and xpcshell test run again with the following results:

Result

DKrfvcXxQ3W9dfC7XTFr7Q

11:13:37     INFO -  INFO | Result summary:
11:13:37     INFO -  INFO | Passed: 3171
11:13:37  WARNING -  INFO | Failed: 76
11:13:37  WARNING -  One or more unittests failed.
11:13:37     INFO -  INFO | Todo: 4
11:13:37     INFO -  INFO | Retried: 88
11:13:37     INFO -  SUITE-END | took 4631s