1866805 - Perma OSX WebRender opt/shippable browser-chrome tests [taskcluster:error] Task aborted - max run time exceeded

Status: RESOLVED FIXED

(Testing :: Mochitest, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=437764538&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/aZjjpthiSL-LX0UjzUKvag/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-11-27T11:51:25.928Z] 11:51:25     INFO - TEST-START | toolkit/components/antitracking/test/browser/browser_referrerDefaultPolicy.js
[task 2023-11-27T11:51:26.233Z] 11:51:26     INFO - GECKO(6372) | 1701085886232	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[task 2023-11-27T11:51:26.250Z] 11:51:26     INFO - GECKO(6372) | JavaScript error: resource://gre/modules/XULStore.sys.mjs, line 60: Error: Can't find profile directory.
[task 2023-11-27T11:51:26.259Z] 11:51:26     INFO - GECKO(6372) | JavaScript error: resource://gre/modules/XULStore.sys.mjs, line 60: Error: Can't find profile directory.
[task 2023-11-27T11:51:26.259Z] 11:51:26     INFO - GECKO(6372) | JavaScript error: resource://gre/modules/XULStore.sys.mjs, line 60: Error: Can't find profile directory.
[task 2023-11-27T11:51:26.571Z] 11:51:26     INFO - GECKO(6372) | JavaScript error: resource://gre/actors/CookieBannerChild.sys.mjs, line 272: InvalidStateError: JSWindowActorChild.sendAsyncMessage: JSWindowActorChild cannot send at the moment
[task 2023-11-27T11:51:26.594Z] 11:51:26     INFO - GECKO(6372) | JavaScript error: resource://gre/actors/CookieBannerChild.sys.mjs, line 272: InvalidStateError: JSWindowActorChild.sendAsyncMessage: JSWindowActorChild cannot send at the moment
[task 2023-11-27T11:51:26.761Z] 11:51:26     INFO - GECKO(6372) | 1701085886760	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[task 2023-11-27T11:51:26.803Z] 11:51:26     INFO - GECKO(6372) | JavaScript error: resource://gre/modules/XULStore.sys.mjs, line 60: Error: Can't find profile directory.
[task 2023-11-27T11:51:27.515Z] 11:51:27     INFO - GECKO(6372) | JavaScript error: resource://gre/actors/CookieBannerChild.sys.mjs, line 272: InvalidStateError: JSWindowActorChild.sendAsyncMessage: JSWindowActorChild cannot send at the moment
<...>
[task 2023-11-27T11:52:04.798Z] 11:52:04     INFO - GECKO(6372) | 1701085924797	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[task 2023-11-27T11:52:05.156Z] 11:52:05     INFO - GECKO(6372) | JavaScript error: resource:///actors/ContentSearchParent.sys.mjs, line 648: TypeError: can't access property "addEventListener", browser is null
[task 2023-11-27T11:52:05.156Z] 11:52:05     INFO - GECKO(6372) | JavaScript error: resource:///actors/ContentSearchParent.sys.mjs, line 648: TypeError: can't access property "addEventListener", browser is null
[task 2023-11-27T11:52:05.352Z] 11:52:05     INFO - GECKO(6372) | 1701085925351	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[task 2023-11-27T11:52:05.975Z] 11:52:05     INFO - GECKO(6372) | 1701085925974	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[task 2023-11-27T11:52:06.582Z] 11:52:06     INFO - GECKO(6372) | 1701085926581	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[task 2023-11-27T11:52:07.179Z] 11:52:07     INFO - GECKO(6372) | 1701085927179	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[task 2023-11-27T11:52:07.819Z] 11:52:07     INFO - GECKO(6372) | 1701085927818	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[task 2023-11-27T11:52:08.263Z] 11:52:08     INFO - GECKO(6372) | 1701085928262	Marionette	TRACE	Received observer notification browser-delayed-startup-finished
[taskcluster:error] Aborting task...
[taskcluster:warn 2023-11-27T11:52:08.741Z] no such process
[taskcluster 2023-11-27T11:52:08.741Z] === Task Finished ===
[taskcluster 2023-11-27T11:52:08.741Z] Task Duration: 1h0m0.257681s
[taskcluster 2023-11-27T11:52:08.816Z] Uploading artifact public/logs/localconfig.json from file /opt/worker/tasks/task_170108232509823/logs/localconfig.json with content encoding "gzip", mime type "application/json" and expiry 2024-11-26T10:26:57.921Z
[taskcluster 2023-11-27T11:52:09.154Z] Uploading artifact public/test_info/manifests.list from file /opt/worker/tasks/task_170108232509823/build/blobber_upload_dir/manifests.list with content encoding "gzip", mime type "text/plain; charset=utf-8" and expiry 2024-11-26T10:26:57.921Z
[taskcluster 2023-11-27T11:52:09.434Z] Uploading artifact public/test_info/mochitest-browser-chrome_errorsummary.log from file /opt/worker/tasks/task_170108232509823/build/blobber_upload_dir/mochitest-browser-chrome_errorsummary.log with content encoding "gzip", mime type "text/plain" and expiry 2024-11-26T10:26:57.921Z
[taskcluster 2023-11-27T11:52:09.700Z] Uploading artifact public/test_info/system-info.log from file /opt/worker/tasks/task_170108232509823/build/blobber_upload_dir/system-info.log with content encoding "gzip", mime type "text/plain" and expiry 2024-11-26T10:26:57.921Z
[taskcluster 2023-11-27T11:52:10.000Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-11-26T10:26:57.921Z
[taskcluster:error] Task aborted - max run time exceeded

Comment 1

[Iulian Moraru]

Hi Joel! Can you please take a look at this? It seems that this issue has started happening again.
Thank you!

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

this has been on the border of timeout for weeks; with 8 chunks if we could perfectly balance they would all run in <40 minutes. I think we should strive for that and if needed then we work on going to 10 chunks.

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

it appears increasing the chunks is the way to go.

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1866805 - add more chunks for osx browser-chrome. r=aryx!

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ba6f5742e3d4
add more chunks for osx browser-chrome. r=aryx

Comment 6

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/ba6f5742e3d4

Comment 7

[Intermittent Failures Robot]

15 failures in 4108 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 4
• try: 4
• mozilla-beta: 2

Platform and build breakdown:

• macosx1015-64-qr: 5
  • opt: 5
• macosx1015-64-shippable-qr: 6
  • opt: 6
• macosx1015-64-devedition-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866805&startday=2023-11-27&endday=2023-12-03&tree=all

Comment 8

[Iulian Moraru]

Hi Joel! Can you please take another look at this? It seems that this is still permafailing but now only on OS X 10.15 WebRender Shippable.
This range is from where the fix for this got merged to central and the issue is still there.
Thank you!

Should we file a new bug or re-open this one?

Comment 9

[Joel Maher ( :jmaher ) (UTC -8)]

this was a mistake, I fixed opt, but missed shippable

Comment 10

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1866805 - split osx browser-chrome to 10 chunks on shippable. r=aryx!

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d8ecfd410a3d
split osx browser-chrome to 10 chunks on shippable. r=aryx

Comment 12

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/d8ecfd410a3d

Comment 13

[Intermittent Failures Robot]

6 failures in 3671 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 6

Platform and build breakdown:

• macosx1015-64-shippable-qr: 6
  • opt: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1866805&startday=2023-12-04&endday=2023-12-10&tree=all