1931315 - Almost perma tests/jit-test/jit-test/tests/atomics/pause-multi.js | Timeout (code -6, args "--enable-atomics-pause --blinterp-eager") [970.2 s]

Status: RESOLVED FIXED

(Core :: JavaScript Engine: JIT, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: agoloman [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=482634655&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Tz94Uf9VRuW-9ZTH1IPRTg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-11-14T11:16:09.105Z] 11:16:09     INFO -  TEST-PASS | tests/jit-test/jit-test/tests/closures/t001.js | Success (code 0, args "--ion-eager --ion-offthread-compile=off --ion-check-range-analysis --ion-extra-checks --no-sse3 --no-threads") [0.1 s]
[task 2024-11-14T11:27:54.919Z] 11:27:54     INFO -  Exit code: -6
[task 2024-11-14T11:27:54.919Z] 11:27:54     INFO -  TIMEOUT - atomics/pause-multi.js
[task 2024-11-14T11:27:54.919Z] 11:27:54  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/atomics/pause-multi.js | Timeout (code -6, args "--enable-atomics-pause --blinterp-eager") [970.2 s]
[task 2024-11-14T11:27:54.921Z] 11:27:54     INFO -  INFO exit-status     : -6
[task 2024-11-14T11:27:54.921Z] 11:27:54     INFO -  INFO timed-out       : 0:00:00.150195
[task 2024-11-14T11:27:54.921Z] 11:27:54     INFO -  FAILURES:
[task 2024-11-14T11:27:54.921Z] 11:27:54     INFO -  TIMEOUTS:
[task 2024-11-14T11:27:54.921Z] 11:27:54     INFO -      --enable-atomics-pause --blinterp-eager atomics/pause-multi.js
[task 2024-11-14T11:27:54.921Z] 11:27:54     INFO -  Result summary:
[task 2024-11-14T11:27:54.921Z] 11:27:54     INFO -  Passed: 17095
[task 2024-11-14T11:27:54.921Z] 11:27:54  WARNING -  Failed: 1
[task 2024-11-14T11:27:54.921Z] 11:27:54  WARNING -  One or more unittests failed.
[task 2024-11-14T11:27:54.930Z] 11:27:54     INFO - Return code: 2
[task 2024-11-14T11:27:54.931Z] 11:27:54     INFO - TinderboxPrint: jittest-jittest<br/>17095/<em class="testfail">1</em>
[task 2024-11-14T11:27:54.932Z] 11:27:54  WARNING - setting return code to 2
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - The jittest suite: jittest ran with return status: FAILURE
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - Running post-action listener: _package_coverage_data
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - Running post-action listener: _resource_record_post_action
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - Running post-action listener: process_java_coverage_data
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - [mozharness: 2024-11-14 11:27:54.932883Z] Finished run-tests step (success)
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - [mozharness: 2024-11-14 11:27:54.932903Z] Running uninstall step.
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - Running pre-action listener: _resource_record_pre_action
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - Running main action method: uninstall
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - Skipping uninstall for non-MSIX test
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - Running post-action listener: _resource_record_post_action
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - [mozharness: 2024-11-14 11:27:54.932967Z] Finished uninstall step (success)
[task 2024-11-14T11:27:54.932Z] 11:27:54     INFO - Running post-run listener: _resource_record_post_run
[task 2024-11-14T11:27:55.093Z] 11:27:55     INFO - instance_metadata.json not found; unable to determine instance type
[task 2024-11-14T11:27:55.100Z] 11:27:55     INFO - Validating Perfherder data against /opt/worker/tasks/task_173158076826289/mozharness/external_tools/performance-artifact-schema.json
[task 2024-11-14T11:27:55.101Z] 11:27:55     INFO - PERFHERDER_DATA: {"framework": {"name": "job_resource_usage"}, "suites": [{"name": "jittest.jittest.1.overall", "extraOptions": ["buildbot-unknown"], "subtests": [{"name": "cpu_percent", "value": 55.78840918833864}, {"name": "io_write_bytes", "value": 13214523392}, {"name": "io.read_bytes", "value": 11394666496}, {"name": "io_write_time", "value": 87123}, {"name": "io_read_time", "value": 127622}]}, {"name": "jittest.jittest.1.start-pulseaudio", "subtests": [{"name": "time", "value": 9.600000021237065e-05}, {"name": "cpu_percent", "value": 0}]}, {"name": "jittest.jittest.1.install", "subtests": [{"name": "time", "value": 16.511063082999954}, {"name": "cpu_percent", "value": 19.108720930232554}]}, {"name": "jittest.jittest.1.stage-files", "subtests": [{"name": "time", "value": 0.00013712500003748573}, {"name": "cpu_percent", "value": 0}]}, {"name": "jittest.jittest.1.run-tests", "subtests": [{"name": "time", "value": 1068.750545334}, {"name": "cpu_percent", "value": 56.24708616697927}]}, {"name": "jittest.jittest.1.uninstall", "subtests": [{"name": "time", "value": 4.3167000058019767e-05}, {"name": "cpu_percent", "value": 0}]}]}
[task 2024-11-14T11:27:55.101Z] 11:27:55     INFO - Total resource usage - Wall time: 1085s; CPU: Can't collect data; Read bytes: 11394666496; Write bytes: 13214523392; Read time: 127622; Write time: 87123
[task 2024-11-14T11:27:55.101Z] 11:27:55     INFO - TinderboxPrint: I/O read bytes / time<br/>11,394,666,496 / 127,622
[task 2024-11-14T11:27:55.101Z] 11:27:55     INFO - TinderboxPrint: I/O write bytes / time<br/>13,214,523,392 / 87,123
[task 2024-11-14T11:27:55.101Z] 11:27:55     INFO - TinderboxPrint: CPU idle<br/>4,774.8 (55.0%)
[task 2024-11-14T11:27:55.101Z] 11:27:55     INFO - TinderboxPrint: CPU system<br/>639.9 (7.4%)
[task 2024-11-14T11:27:55.101Z] 11:27:55     INFO - TinderboxPrint: CPU user<br/>3,266.7 (37.6%)
[task 2024-11-14T11:27:55.101Z] 11:27:55     INFO - TinderboxPrint: Swap in / out<br/>645,562,368 / 2,326,528
[task 2024-11-14T11:27:55.102Z] 11:27:55     INFO - start-pulseaudio - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-11-14T11:27:55.103Z] 11:27:55     INFO - install - Wall time: 17s; CPU: 19%; Read bytes: 397649920; Write bytes: 400052224; Read time: 14271; Write time: 393
[task 2024-11-14T11:27:55.103Z] 11:27:55     INFO - stage-files - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-11-14T11:27:55.122Z] 11:27:55     INFO - run-tests - Wall time: 1069s; CPU: 56%; Read bytes: 11387555840; Write bytes: 12814454784; Read time: 127461; Write time: 86730
[task 2024-11-14T11:27:55.123Z] 11:27:55     INFO - uninstall - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-11-14T11:27:55.742Z] 11:27:55  WARNING - returning nonzero exit status 2
[taskcluster 2024-11-14T11:27:55.794Z]    Exit Code: 2
[taskcluster 2024-11-14T11:27:55.794Z]    User Time: 48m53.42301s
[taskcluster 2024-11-14T11:27:55.794Z]  Kernel Time: 5m45.688149s
[taskcluster 2024-11-14T11:27:55.794Z]    Wall Time: 18m58.492382s
[taskcluster 2024-11-14T11:27:55.794Z]       Result: FAILED
[taskcluster 2024-11-14T11:27:55.794Z] === Task Finished ===
[taskcluster 2024-11-14T11:27:55.794Z] Task Duration: 18m58.499445s
[taskcluster 2024-11-14T11:27:55.887Z] Uploading artifact public/logs/localconfig.json from file /opt/worker/tasks/task_173158076826289/logs/localconfig.json with content encoding "gzip", mime type "application/json" and expiry 2025-11-14T10:15:23.520Z
[taskcluster 2024-11-14T11:27:56.213Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-11-14T10:15:23.520Z
[taskcluster:error] exit status 2

Comment 2

[André Bargull [:anba]]

Let's see if reducing the number of iterations is sufficient: https://treeherder.mozilla.org/jobs?repo=try&revision=6c03474a2198c7a663b79468129df78cffaa387b

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1930952

Comment 4

[Intermittent Failures Robot]

32 failures in 1008 pushes (0.032 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 30
• mozilla-central: 2

Platform and build breakdown:

• macosx1100-64-qr: 8
  • debug: 8
• android-hw-p5-13-0-android-aarch64-qr: 7
  • opt: 6
  • debug: 1
• macosx1015-64-qr: 11
  • opt: 10
  • debug: 1
• linux64: 3
  • debug: 2
  • opt: 1
• linux32: 1
  • debug: 1
• windows2012-64: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1931315&startday=2024-11-14&endday=2024-11-14&tree=all

Comment 5

[André Bargull [:anba]]

Attachment: Bug 1931315: Rework Atomics.pause to avoid intermittent failures. r=iain!

• Perform a single call setSharedObject.
• Reduce the number of iterations to further decrease the time needed to complete
  the test.
• Simplify the critical section in the worker threads to a non-atomic
  load-and-store. This avoids interactions with the main-thread, which should
  help to make the test more reliable.
• Check that Atomics.notify actually notified all worker threads.

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5a74bc283968
Rework Atomics.pause to avoid intermittent failures. r=iain

Comment 7

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/5a74bc283968

Comment 8

[Intermittent Failures Robot]

21 failures in 894 pushes (0.023 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 7

Platform and build breakdown:

• linux64: 5
  • debug: 3
  • opt: 2
• android-hw-p5-13-0-android-aarch64-qr: 5
  • opt: 3
  • debug: 2
• macosx1100-64-qr: 4
  • debug: 4
• macosx1015-64-qr: 3
  • opt: 2
  • debug: 1
• windows2012-32: 1
  • opt: 1
• android-hw-p5-13-0-arm7-qr: 1
  • debug: 1
• android-hw-p5-13-0-android-aarch64-shippable-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1931315&startday=2024-11-15&endday=2024-11-15&tree=all

Comment 9

[Intermittent Failures Robot]

53 failures in 4227 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #29 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 44
• mozilla-central: 9

Platform and build breakdown:

• linux64: 8
  • debug: 5
  • opt: 3
• android-hw-p5-13-0-android-aarch64-qr: 12
  • opt: 9
  • debug: 3
• macosx1100-64-qr: 12
  • debug: 12
• macosx1015-64-qr: 14
  • opt: 12
  • debug: 2
• windows2012-32: 1
  • opt: 1
• linux32: 1
  • debug: 1
• windows2012-64: 2
  • opt: 2
• android-hw-p5-13-0-arm7-qr: 1
  • debug: 1
• android-hw-p5-13-0-android-aarch64-shippable-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1931315&startday=2024-11-11&endday=2024-11-17&tree=all

Comment 10

[Intermittent Failures Robot]

53 failures in 4227 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #29 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 44
• mozilla-central: 9

Platform and build breakdown:

• linux64: 8
  • debug: 5
  • opt: 3
• android-hw-p5-13-0-android-aarch64-qr: 12
  • opt: 9
  • debug: 3
• macosx1100-64-qr: 12
  • debug: 12
• macosx1015-64-qr: 14
  • opt: 12
  • debug: 2
• windows2012-32: 1
  • opt: 1
• linux32: 1
  • debug: 1
• windows2012-64: 2
  • opt: 2
• android-hw-p5-13-0-arm7-qr: 1
  • debug: 1
• android-hw-p5-13-0-android-aarch64-shippable-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1931315&startday=2024-11-11&endday=2024-11-17&tree=all