1932535 - Perma [Tier 2] toolkit/components/ml/tests/browser/browser_ml_engine_perf.js / browser_ml_engine_multi_perf.js | Test timed out -

Status: RESOLVED FIXED

(Core :: Machine Learning, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: smolnar [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=483575003&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/PLpARRN-QsW2JwRrYOf2yw/runs/0/artifacts/public/logs/live_backing.log

---

Failed to retrieve MOZ_UPLOAD_DIR env var
[task 2024-11-21T02:35:01.342Z] TEST-UNEXPECTED-FAIL | toolkit/components/ml/tests/browser/browser_ml_engine_perf.js | Test timed out - 
[task 2024-11-21T02:35:01.342Z] GECKO(3069) | Completed ShutdownLeaks collections in process 3069
[task 2024-11-21T02:35:01.342Z] TEST-START | Shutdown
[task 2024-11-21T02:35:01.342Z] Browser Chrome Test Summary
[task 2024-11-21T02:35:01.342Z] Passed:  0
[task 2024-11-21T02:35:01.342Z] Failed:  1
[task 2024-11-21T02:35:01.342Z] Todo:    0
[task 2024-11-21T02:35:01.342Z] Mode:    e10s
[task 2024-11-21T02:35:01.342Z] *** End BrowserChrome Test Results ***
[task 2024-11-21T02:35:01.342Z] GECKO(3069) | Exiting due to channel error.
[task 2024-11-21T02:35:01.342Z] GECKO(3069) | Exiting due to channel error.
[task 2024-11-21T02:35:01.342Z] GECKO(3069) | Exiting due to channel error.
[task 2024-11-21T02:35:01.342Z] GECKO(3069) | Exiting due to channel error.
[task 2024-11-21T02:35:01.342Z] GECKO(3069) | Exiting due to channel error.
[task 2024-11-21T02:35:01.342Z] GECKO(3069) | Exiting due to channel error.
[task 2024-11-21T02:35:01.342Z] GECKO(3069) | Exiting due to channel error.
[task 2024-11-21T02:35:01.342Z] GECKO(3069) | Exiting due to channel error.
[task 2024-11-21T02:35:01.342Z] TEST-INFO | Main app process: exit 0
[task 2024-11-21T02:35:01.342Z] runtests.py | Application ran for: 1:32:27.145669
[task 2024-11-21T02:35:01.342Z] zombiecheck | Reading PID log: /tmp/tmp50m5h375pidlog
[task 2024-11-21T02:35:01.342Z] ==> process 3069 launched child process 3143
[task 2024-11-21T02:35:01.342Z] zombiecheck | Checking for orphan process with PID: 3143
[task 2024-11-21T02:35:01.342Z] Stopping web server
[task 2024-11-21T02:35:01.342Z] Server shut down.
[task 2024-11-21T02:35:01.342Z] Web server killed.
[task 2024-11-21T02:35:01.342Z] Stopping web socket server
[task 2024-11-21T02:35:01.342Z] Stopping ssltunnel
[task 2024-11-21T02:35:01.342Z] leakcheck | refcount logging is off, so leaks can't be detected!
[task 2024-11-21T02:35:01.342Z] runtests.py | Running tests: end.
[task 2024-11-21T02:35:01.342Z] Buffered messages finished
[task 2024-11-21T02:35:01.342Z] TEST-INFO | checking window state
[task 2024-11-21T02:35:01.342Z] Browser Chrome Test Summary
[task 2024-11-21T02:35:01.342Z] 	Passed: 0
[task 2024-11-21T02:35:01.342Z] 	Failed: 1
[task 2024-11-21T02:35:01.342Z] 	Todo: 0
[task 2024-11-21T02:35:01.342Z] 	Mode: e10s
[task 2024-11-21T02:35:01.342Z] *** End BrowserChrome Test Results ***
[task 2024-11-21T02:35:01.342Z] Buffered messages finished
[task 2024-11-21T02:35:01.342Z] SUITE-END | took 5547s
[task 2024-11-21T02:35:01.342Z] Traceback (most recent call last):
[task 2024-11-21T02:35:01.342Z]   File "python/mozperftest/mozperftest/runner.py", line 299, in <module>
[task 2024-11-21T02:35:01.342Z]     sys.exit(main())
[task 2024-11-21T02:35:01.342Z]   File "python/mozperftest/mozperftest/runner.py", line 295, in main
[task 2024-11-21T02:35:01.342Z]     run_tests(mach_cmd, args, user_args)
[task 2024-11-21T02:35:01.342Z]   File "python/mozperftest/mozperftest/runner.py", line 188, in run_tests
[task 2024-11-21T02:35:01.342Z]     e.run(metadata)
[task 2024-11-21T02:35:01.342Z]   File "/home/cltbld/tasks/task_173215089223890/fetches/python/mozperftest/mozperftest/environment.py", line 92, in run
[task 2024-11-21T02:35:01.342Z]     metadata = testlayer(syslayer(metadata))
[task 2024-11-21T02:35:01.343Z]   File "/home/cltbld/tasks/task_173215089223890/fetches/python/mozperftest/mozperftest/layers.py", line 157, in __call__
[task 2024-11-21T02:35:01.343Z]     metadata = layer(metadata)
[task 2024-11-21T02:35:01.343Z]   File "/home/cltbld/tasks/task_173215089223890/fetches/python/mozperftest/mozperftest/layers.py", line 69, in __call__
[task 2024-11-21T02:35:01.343Z]     metadata = self.run(metadata)
[task 2024-11-21T02:35:01.343Z]   File "/home/cltbld/tasks/task_173215089223890/fetches/python/mozperftest/mozperftest/test/mochitest.py", line 192, in run
[task 2024-11-21T02:35:01.343Z]     raise MochitestTestFailure("Test failed to run")
[task 2024-11-21T02:35:01.343Z] mozperftest.test.mochitest.MochitestTestFailure: Test failed to run
[taskcluster 2024-11-21T02:35:01.605Z]    Exit Code: 1
[taskcluster 2024-11-21T02:35:01.605Z]    User Time: 1m14.809131s
[taskcluster 2024-11-21T02:35:01.605Z]  Kernel Time: 13.102827s
[taskcluster 2024-11-21T02:35:01.605Z]    Wall Time: 1h33m28.057132158s
[taskcluster 2024-11-21T02:35:01.605Z]       Result: FAILED
[taskcluster 2024-11-21T02:35:01.605Z] === Task Finished ===
[taskcluster 2024-11-21T02:35:01.605Z] Task Duration: 1h33m28.060534262s
[taskcluster 2024-11-21T02:35:01.673Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-11-21T00:49:20.485Z
[taskcluster:error] exit status 1

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1932221

Comment 2

[Tarek Ziadé (:tarek)]

probably the same issue in Bug 1932613

Comment 3

[Iulian Moraru]

This test TEST-UNEXPECTED-FAIL | toolkit/components/ml/tests/browser/browser_ml_engine_multi_perf.js | Test timed out - is also perma failing.

Comment 4

[Intermittent Failures Robot]

65 failures in 377 pushes (0.172 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 40
• mozilla-central: 25

Platform and build breakdown:

• macosx1015-64-shippable-qr: 20
  • opt: 20
• linux1804-64-shippable: 25
  • opt: 25
• windows11-64-shippable-qr: 20
  • opt: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1932535&startday=2024-11-21&endday=2024-11-21&tree=all

Comment 5

[Nika Layzell [:nika] (ni? for response)]

Attachment: Bug 1932535 - Allow shared memory access to propagate into nested non-chrome workers, r=#dom-worker-reviewers!

This is not the most elegant solution, but should work as well as the
previous setup.

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/af8da021be3b
Allow shared memory access to propagate into nested non-chrome workers, r=dom-worker-reviewers,asuth

Comment 7

[Drew Willcoxon :adw]

Linking this to the ML Yelp metabug just for future reference, since this fixes a hang in engine creation that affected Yelp over the past couple days. Thanks Nika!

Comment 8

[Intermittent Failures Robot]

42 failures in 366 pushes (0.115 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 24
• mozilla-central: 18

Platform and build breakdown:

• linux1804-64-shippable: 14
  • opt: 14
• windows11-64-shippable-qr: 14
  • opt: 14
• macosx1015-64-shippable-qr: 14
  • opt: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1932535&startday=2024-11-22&endday=2024-11-22&tree=all

Comment 9

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/af8da021be3b

Comment 10

[Intermittent Failures Robot]

116 failures in 3002 pushes (0.039 failures/push) were associated with this bug in the last 7 days.

This is the #7 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 73
• mozilla-central: 43

Platform and build breakdown:

• macosx1015-64-shippable-qr: 36
  • opt: 36
• linux1804-64-shippable: 44
  • opt: 44
• windows11-64-shippable-qr: 36
  • opt: 36

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1932535&startday=2024-11-18&endday=2024-11-24&tree=all