1768867 - Intermittent raptor-browsertime Critical: Couldn't execute async script named toggle composition recorder error:ScriptTimeoutError: Timed out after 60000 / 120000 / 144000 ms

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=377679337&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/JrVgL6FHQMSnuxtA5S3S1Q/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-05-11T13:23:06.493Z] 13:23:06     INFO -  raptor-browsertime Info: Start firefox window recorder.
[task 2022-05-11T13:24:29.721Z] 13:24:29     INFO -  raptor-browsertime Info: Stop firefox window recorder.
[task 2022-05-11T13:26:53.763Z] 13:26:53    ERROR -  raptor-browsertime Error: Browsertime failed to run
[task 2022-05-11T13:26:53.785Z] 13:26:53 CRITICAL -  raptor-browsertime Critical: Couldn't execute async script named toggle composition recorder error:ScriptTimeoutError: Timed out after 144000 ms
[task 2022-05-11T13:26:53.786Z] 13:26:53     INFO -  raptor-perftest Info: Removing temporary directory: /var/folders/6_/2fr28cdd7y77jbw9wg779c0r000014/T/tmpmhlf7qmh
[task 2022-05-11T13:26:53.802Z] 13:26:53    ERROR -  Traceback (most recent call last):
[task 2022-05-11T13:26:53.802Z] 13:26:53     INFO -    File "/opt/worker/tasks/task_165227504541766/build/tests/raptor/raptor/raptor.py", line 215, in <module>
[task 2022-05-11T13:26:53.802Z] 13:26:53     INFO -      main()
[task 2022-05-11T13:26:53.803Z] 13:26:53     INFO -    File "/opt/worker/tasks/task_165227504541766/build/tests/raptor/raptor/raptor.py", line 161, in main
[task 2022-05-11T13:26:53.803Z] 13:26:53     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2022-05-11T13:26:53.803Z] 13:26:53     INFO -    File "/opt/worker/tasks/task_165227504541766/build/tests/raptor/raptor/perftest.py", line 457, in run_tests
[task 2022-05-11T13:26:53.803Z] 13:26:53     INFO -      self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2022-05-11T13:26:53.804Z] 13:26:53     INFO -    File "/opt/worker/tasks/task_165227504541766/build/tests/raptor/raptor/browsertime/base.py", line 601, in run_test
[task 2022-05-11T13:26:53.804Z] 13:26:53     INFO -      raise Exception(self.browsertime_failure)
[task 2022-05-11T13:26:53.804Z] 13:26:53     INFO -  Exception: Couldn't execute async script named toggle composition recorder error:ScriptTimeoutError: Timed out after 144000 ms
[task 2022-05-11T13:26:54.014Z] 13:26:54    ERROR - Return code: 1
[task 2022-05-11T13:26:54.014Z] 13:26:54  WARNING - setting return code to 1
[task 2022-05-11T13:26:54.015Z] 13:26:54     INFO - Copying Raptor results to upload dir:
[task 2022-05-11T13:26:54.015Z] 13:26:54     INFO - /opt/worker/tasks/task_165227504541766/build/blobber_upload_dir/perfherder-data.json
[task 2022-05-11T13:26:54.015Z] 13:26:54     INFO - Copying raptor results from /opt/worker/tasks/task_165227504541766/build/raptor.json to /opt/worker/tasks/task_165227504541766/build/blobber_upload_dir/perfherder-data.json
[task 2022-05-11T13:26:54.016Z] 13:26:54 CRITICAL - Error copying results /opt/worker/tasks/task_165227504541766/build/raptor.json to upload dir /opt/worker/tasks/task_165227504541766/build/blobber_upload_dir/perfherder-data.json
[task 2022-05-11T13:26:54.016Z] 13:26:54     INFO - [Errno 2] No such file or directory: '/opt/worker/tasks/task_165227504541766/build/raptor.json'

Comment 1

[Natalia Csoregi [:nataliaCs]]

The raptor failure started with https://treeherder.mozilla.org/jobs?repo=mozilla-central&searchStr=os%2Cx%2C10.15%2Cwebrender%2Cshippable%2Copt%2Cbrowsertime%2Cperformance%2Ctests%2Con%2Cfirefox%2Ctest-macosx1015-64-shippable-qr%2Fopt-browsertime-tp6-live-sheriffed-firefox-cnn-e10s%2Ccnn&fromchange=b6dca56b56ccf7002c5a222a109898a3c32c82a8&group_state=expanded&selectedTaskRun=JrVgL6FHQMSnuxtA5S3S1Q.0 - most probably caused by Bug 1767797?

Greg, is there any chance you could take a look over this?
Thank you.

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1767797

Comment 3

[Greg Mierzwinski [:sparky]]

:barret, it looks like the Window Recorder is having a lot of issues stopping on this test on the mac platform. Would you be able to look into it? If not, could you redirect the needinfo?

Comment 4

[Greg Mierzwinski [:sparky]]

In the worst case, I can try using ffmpeg for recording but it's preferred to continue using the firefox window recorder.

Comment 5

[Beth Rennie [:beth] (she/her)]

I don't know why this is failing. I tried disabling/enabling the composition recorder directly on the latest macOS nightly (ie running windowUtils.setCompositionRecording(true|false) from the browser console) directly and the recorder itself seems to be working.

This is the script that is running in browserTime. Maybe you could add logging here to see whats up, e.g.

      const cb = arguments[arguments.length-1];
      Promise.resolve(
        windowUtils.setCompositionRecording(${enable})
      )
        .catch(e => console.log("*** e = " + e)
        .then(() => cb());

Comment 6

[Greg Mierzwinski [:sparky]]

Thanks :barret, I've made a try run with those changes to see what we find: https://treeherder.mozilla.org/#/jobs?repo=try&revision=ecdb4d391f8958208272af97600666380bf77f2e

Comment 7

[Greg Mierzwinski [:sparky]]

Something else that is interesting is that this is only happening on non-fission tests.

Comment 8

[Intermittent Failures Robot]

15 failures in 549 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 14
• mozilla-release: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 13
  • opt: 13
• windows10-64-shippable-qr: 1
  • opt: 1
• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-05-11&endday=2022-05-11&tree=all

Comment 9

[Greg Mierzwinski [:sparky]]

:barret, would you have any thoughts on what else we could try? The try run from yesterday didn't produce an error message: https://treeherder.mozilla.org/jobs?repo=try&tier=1%2C2%2C3&revision=ecdb4d391f8958208272af97600666380bf77f2e&selectedTaskRun=ReFcdudGQUWfgqYEm4Aqnw.0

It's timing out while it's trying to stop the recorder without an error being thrown. I could increase the timeout but 2.5 minutes already feels quite high.

Comment 10

[Beth Rennie [:beth] (she/her)]

I just tried enabling & disabling the composition recorder on the latest nightly with fission disabled and it worked, so I don't have any concrete ideas as to what is going on. Next steps would be to add some logging into Firefox to see whats going on.

The call path is as follows:

• WindowUtils::StopCompositionRecording()
  • This is the main entry point. Since we are calling setCompositionRecording(false), we will enter this branch. This calls SendEndRecordingToDisk(), which is received by the CompositorBridgeParent:
• CompositorBridgeParent::RecvStopRecordingToDIsk()
• WebRenderBridgeParent::WriteCollectedFrames()
• WebRenderAPI::WriteCollectedFrames()
  • This sets up a runnable WriteCollectedFramesEvent to run on the render thread.
• WriteCollectedFramesEvent::Run
  • This is the entry point on the render thread where we request the RenderThread to write its collected frames.
• RenderThread::WriteCollectedFramesForWindow()
• RendererOGL::WriteCollectedFrames()
• CompositionRecorder::WriteCollectedFrames()
  • This is where we actually write the frames to disk. It's possible we are just taking too long to write our frames here if there are too many captured.

Comment 11

[Greg Mierzwinski [:sparky]]

Ok, I wonder if there's any value in keeping this test running with fission disabled. :davehunt, what do you think?

Comment 13

[Intermittent Failures Robot]

47 failures in 3317 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #22 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-release: 3
• mozilla-beta: 10
• mozilla-central: 34

Platform and build breakdown:

• macosx1015-64-shippable-qr: 38
  • opt: 38
• windows10-64-shippable-qr: 1
  • opt: 1
• linux1804-64-clang-trunk-qr: 8
  • opt: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-05-09&endday=2022-05-15&tree=all

Comment 14

[Dave Hunt [:davehunt] [he/him] ⌚BST]

(In reply to Greg Mierzwinski [:sparky] from comment #11)

Ok, I wonder if there's any value in keeping this test running with fission disabled. :davehunt, what do you think?

If it's only failing in non-Fission then I don't see a good reason to keep it running. If we're still running other tests with Fission disabled then perhaps those should be disabled too? :jmaher do you see a reason to keep non-Fission tests around?

Comment 15

[Joel Maher ( :jmaher ) (UTC -8)]

we only ship fission by default; users can hack their prefs to disable fission, but for all desktop fission is and has been the default config. Android is different, fission still has a roadmap to walk down- but we run all our unit/perf tests on android in no-fission.

I vote for turning off the no-fission version of the tests on desktop.

Comment 16

[Intermittent Failures Robot]

11 failures in 2694 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 9
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-shippable-qr: 10
  • opt: 10
• android-hw-p2-8-0-android-aarch64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-05-16&endday=2022-05-22&tree=all

Comment 17

[Intermittent Failures Robot]

5 failures in 2624 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-release: 2
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-shippable-qr: 4
  • opt: 4
• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-05-23&endday=2022-05-29&tree=all

Comment 18

[Intermittent Failures Robot]

25 failures in 2917 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• mozilla-release: 1
• mozilla-beta: 6
• mozilla-central: 6

Platform and build breakdown:

• macosx1015-64-shippable-qr: 25
  • opt: 25

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-05-30&endday=2022-06-05&tree=all

Comment 19

[Intermittent Failures Robot]

25 failures in 3336 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 10
• mozilla-beta: 8
• autoland: 6
• mozilla-release: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 25
  • opt: 25

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-06-06&endday=2022-06-12&tree=all

Comment 20

[Intermittent Failures Robot]

6 failures in 3170 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 1
• mozilla-beta: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 4
  • opt: 4
• linux1804-64-shippable-qr: 1
  • opt: 1
• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-06-13&endday=2022-06-19&tree=all

Comment 21

[Intermittent Failures Robot]

1 failures in 3312 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-06-27&endday=2022-07-03&tree=all

Comment 22

[Intermittent Failures Robot]

4 failures in 3497 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-shippable-qr: 3
  • opt: 3
• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-07-18&endday=2022-07-24&tree=all

Comment 23

[Intermittent Failures Robot]

1 failures in 3057 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-08-01&endday=2022-08-07&tree=all

Comment 24

[Intermittent Failures Robot]

1 failures in 3339 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-08-08&endday=2022-08-14&tree=all

Comment 25

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 26

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=390676282&repo=autoland

Comment 27

[Intermittent Failures Robot]

1 failures in 3023 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-09-12&endday=2022-09-18&tree=all

Comment 28

[Intermittent Failures Robot]

1 failures in 2909 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-09-19&endday=2022-09-25&tree=all

Comment 29

[Intermittent Failures Robot]

1 failures in 2041 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-09-26&endday=2022-10-02&tree=all

Comment 30

[Intermittent Failures Robot]

1 failures in 2449 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-10-03&endday=2022-10-09&tree=all

Comment 31

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 32

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=397315823&repo=mozilla-central

Comment 34

[Intermittent Failures Robot]

5 failures in 3888 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-11-21&endday=2022-11-27&tree=all

Comment 35

[Intermittent Failures Robot]

1 failures in 3938 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-11-28&endday=2022-12-04&tree=all

Comment 36

[Intermittent Failures Robot]

1 failures in 3558 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-12-12&endday=2022-12-18&tree=all

Comment 37

[Intermittent Failures Robot]

1 failures in 2999 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2022-12-19&endday=2022-12-25&tree=all

Comment 38

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 39

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=408037720&repo=mozilla-central

Comment 40

[Intermittent Failures Robot]

2 failures in 3966 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-03-06&endday=2023-03-12&tree=all

Comment 41

[Intermittent Failures Robot]

5 failures in 3863 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4
• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-03-27&endday=2023-04-02&tree=all

Comment 42

[Intermittent Failures Robot]

1 failures in 3386 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-04-03&endday=2023-04-09&tree=all

Comment 43

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 44

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=416106426&repo=mozilla-central

Comment 45

[Intermittent Failures Robot]

1 failures in 3578 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-05-15&endday=2023-05-21&tree=all

Comment 46

[Intermittent Failures Robot]

1 failures in 3471 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-05-29&endday=2023-06-04&tree=all

Comment 47

[Intermittent Failures Robot]

1 failures in 4079 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-06-12&endday=2023-06-18&tree=all

Comment 48

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 49

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=423551446&repo=mozilla-central

Comment 50

[Intermittent Failures Robot]

1 failures in 3520 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-07-17&endday=2023-07-23&tree=all

Comment 51

[Intermittent Failures Robot]

1 failures in 3276 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-07-31&endday=2023-08-06&tree=all

Comment 52

[Intermittent Failures Robot]

1 failures in 3341 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-08-07&endday=2023-08-13&tree=all

Comment 53

[Intermittent Failures Robot]

1 failures in 2218 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-08-21&endday=2023-08-27&tree=all

Comment 54

[Intermittent Failures Robot]

1 failures in 3267 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-09-04&endday=2023-09-10&tree=all

Comment 55

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 56

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=436628327&repo=autoland

Comment 57

[Intermittent Failures Robot]

2 failures in 3495 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-11-13&endday=2023-11-19&tree=all

Comment 58

[Intermittent Failures Robot]

1 failures in 3623 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-11-20&endday=2023-11-26&tree=all

Comment 59

[Intermittent Failures Robot]

3 failures in 3671 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 2
  • opt: 2
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-12-04&endday=2023-12-10&tree=all

Comment 60

[Intermittent Failures Robot]

4 failures in 4224 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1
• mozilla-central: 3

Platform and build breakdown:

• macosx1015-64-shippable-qr: 3
  • opt: 3
• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2023-12-11&endday=2023-12-17&tree=all

Comment 61

[Intermittent Failures Robot]

3 failures in 2274 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-release: 1
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-01-01&endday=2024-01-07&tree=all

Comment 62

[Intermittent Failures Robot]

3 failures in 3217 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 2
  • opt: 2
• macosx1015-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-01-08&endday=2024-01-14&tree=all

Comment 63

[Intermittent Failures Robot]

1 failures in 3599 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-01-15&endday=2024-01-21&tree=all

Comment 64

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 65

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=453531499&repo=autoland

Comment 66

[Intermittent Failures Robot]

1 failures in 3805 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-04-01&endday=2024-04-07&tree=all

Comment 67

[Intermittent Failures Robot]

3 failures in 4336 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 2

Platform and build breakdown:

• macosx1015-64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-04-22&endday=2024-04-28&tree=all

Comment 68

[Intermittent Failures Robot]

1 failures in 4059 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-04-29&endday=2024-05-05&tree=all

Comment 69

[Intermittent Failures Robot]

1 failures in 3649 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-05-06&endday=2024-05-12&tree=all

Comment 70

[Intermittent Failures Robot]

2 failures in 4547 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-clang-trunk-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-05-13&endday=2024-05-19&tree=all

Comment 71

[Intermittent Failures Robot]

1 failures in 3995 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-05-20&endday=2024-05-26&tree=all

Comment 72

[Intermittent Failures Robot]

1 failures in 4202 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-05-27&endday=2024-06-02&tree=all

Comment 73

[Intermittent Failures Robot]

1 failures in 4625 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-06-10&endday=2024-06-16&tree=all

Comment 74

[Intermittent Failures Robot]

4 failures in 4577 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-shippable-qr: 2
  • opt: 2
• linux1804-64-clang-trunk-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-06-17&endday=2024-06-23&tree=all

Comment 75

[Intermittent Failures Robot]

1 failures in 4116 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-06-24&endday=2024-06-30&tree=all

Comment 76

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 77

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=474524517&repo=mozilla-central

Comment 78

[Intermittent Failures Robot]

1 failures in 4860 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-09-16&endday=2024-09-22&tree=all

Comment 79

[Intermittent Failures Robot]

4 failures in 3574 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 2

Platform and build breakdown:

• macosx1015-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-09-30&endday=2024-10-06&tree=all

Comment 80

[Intermittent Failures Robot]

4 failures in 4679 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 2

Platform and build breakdown:

• macosx1015-64-shippable-qr: 3
  • opt: 3
• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-10-07&endday=2024-10-13&tree=all

Comment 81

[Intermittent Failures Robot]

1 failures in 4579 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-10-14&endday=2024-10-20&tree=all

Comment 82

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 83

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=484308506&repo=mozilla-central

Comment 84

[Intermittent Failures Robot]

1 failures in 3953 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-11-25&endday=2024-12-01&tree=all

Comment 85

[Intermittent Failures Robot]

1 failures in 4722 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• windows11-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1768867&startday=2024-12-02&endday=2024-12-08&tree=all

Comment 86

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.