1780717 - Intermittent dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | single tracking bug

Status: REOPENED

(Core :: WebRTC: Audio/Video, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: bszekely [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=385086725&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fMr7DH8ETVSdVmIyUK3nXg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-07-22T05:06:21.276Z] 05:06:21     INFO -   "sdpFmtpLine": "max-fs=12288;max-fr=60",
[task 2022-07-22T05:06:21.277Z] 05:06:21     INFO -   "transportId": "transport_0"
[task 2022-07-22T05:06:21.278Z] 05:06:21     INFO - }
[task 2022-07-22T05:06:21.279Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.id is the same as the report key. 
[task 2022-07-22T05:06:21.280Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.timestamp is not less than 0 
[task 2022-07-22T05:06:21.281Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.timestamp is relative to current time, date=Fri Jul 22 2022 05:06:20 GMT+0000 (Coordinated Universal Time) 
[task 2022-07-22T05:06:21.281Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.ssrc has a value 
[task 2022-07-22T05:06:21.282Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.kind is 'audio' or 'video' 
[task 2022-07-22T05:06:21.284Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.mediaType is 'audio' or 'video' 
[task 2022-07-22T05:06:21.286Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | kind equals legacy mediaType 
[task 2022-07-22T05:06:21.286Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.codecId has a value 
[task 2022-07-22T05:06:21.287Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | codecId 9a94847a exists in report 
[task 2022-07-22T05:06:21.288Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | codecId 9a94847a in report is codec type 
[task 2022-07-22T05:06:21.292Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | codecId 9a94847a in report is for a mimeType of the same media type as the referencing rtp stream stat 
[task 2022-07-22T05:06:21.293Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | remoteId b14e3e85 exists in report. 
[task 2022-07-22T05:06:21.295Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | remote ssrc and local ssrc match. 
[task 2022-07-22T05:06:21.295Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | remote object has local object as it's own local object. 
[task 2022-07-22T05:06:21.296Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.packetsReceived is a sane number for a short audio test. value=222 
[task 2022-07-22T05:06:21.297Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.packetsDiscarded is sane number for a short test. value=0 
[task 2022-07-22T05:06:21.298Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.bytesReceived is a sane number for a short audio test. value=35902 
[task 2022-07-22T05:06:21.299Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.packetsLost is a sane number for a short audio test. value=0 
[task 2022-07-22T05:06:21.300Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.jitter is sane number for a audio local only test. value=0.011 
[task 2022-07-22T05:06:21.300Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.jitterBufferEmittedCount is a sane number for a short audio test. value=210240 
[task 2022-07-22T05:06:21.301Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.jitterBufferDelay is a sane number for a short audio test. value=9465.6/210240=0.045022831050228314 
[task 2022-07-22T05:06:21.302Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp has field totalSamplesReceived when kind is video 
[task 2022-07-22T05:06:21.305Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp has field concealedSamples when kind is video 
[task 2022-07-22T05:06:21.305Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp has field silentConcealedSamples when kind is video 
[task 2022-07-22T05:06:21.306Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.totalSamplesReceived is a sane number for a short audio test. value=211200 
[task 2022-07-22T05:06:21.307Z] 05:06:21     INFO - Buffered messages finished
[task 2022-07-22T05:06:21.308Z] 05:06:21     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.concealedSamples is a sane number for a short audio test. value=0 
[task 2022-07-22T05:06:21.309Z] 05:06:21     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:417:16
[task 2022-07-22T05:06:21.310Z] 05:06:21     INFO - pedanticChecks/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:548:11
[task 2022-07-22T05:06:21.311Z] 05:06:21     INFO - pedanticChecks@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:314:10
[task 2022-07-22T05:06:21.311Z] 05:06:21     INFO - PC_LOCAL_TEST_LOCAL_STATS/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1367:19
[task 2022-07-22T05:06:21.312Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.silentConcealedSamples is a sane number for a short audio test. value=0 
[task 2022-07-22T05:06:21.313Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field firCount when kind is not 'video' 
[task 2022-07-22T05:06:21.313Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field pliCount when kind is not 'video' 
[task 2022-07-22T05:06:21.316Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field framesDecoded when kind is not 'video' 
[task 2022-07-22T05:06:21.317Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field discardedPackets when kind is not 'video' 
[task 2022-07-22T05:06:21.317Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field framesPerSecond when kind is not 'video' 
[task 2022-07-22T05:06:21.318Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field frameWidth when kind is not 'video' 
[task 2022-07-22T05:06:21.319Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field frameHeight when kind is not 'video' 
[task 2022-07-22T05:06:21.320Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field framesReceived when kind is not 'video' 
[task 2022-07-22T05:06:21.321Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.id was tested. 
[task 2022-07-22T05:06:21.322Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.timestamp was tested. 
[task 2022-07-22T05:06:21.323Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.type was tested. 
[task 2022-07-22T05:06:21.324Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.ssrc was tested. 
[task 2022-07-22T05:06:21.325Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.mediaType was tested. 
[task 2022-07-22T05:06:21.326Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.kind was tested. 
[task 2022-07-22T05:06:21.327Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.codecId was tested. 
[task 2022-07-22T05:06:21.333Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.packetsReceived was tested. 
[task 2022-07-22T05:06:21.333Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.packetsLost was tested. 
[task 2022-07-22T05:06:21.334Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.packetsDiscarded was tested. 
[task 2022-07-22T05:06:21.335Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.bytesReceived was tested. 
[task 2022-07-22T05:06:21.336Z] 05:06:21     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.jitter was tested. 

Comment 1

[Iulian Moraru]

First occurrence in this backfill range and retriggers: https://treeherder.mozilla.org/jobs?repo=autoland&searchStr=Linux%2C18.04%2Cx64%2CWebRender%2Cdebug%2CMochitests%2Cwith%2Csoftware%2Cwebrender%2Cwithout%2Cfission%2Cenabled%2Ctest-linux1804-64-qr%2Fdebug-mochitest-media-swr-nofis%2Cmda3&tochange=359e12a89f139443d66898e2e15f798e9d557f93&fromchange=9a95d474f66c0948fc316e372a9454e1197baabb&group_state=expanded&selectedTaskRun=fMr7DH8ETVSdVmIyUK3nXg.0

Comment 2

[Intermittent Failures Robot]

4 failures in 3497 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 1
  • debug: 1
• android-hw-p2-8-0-android-aarch64-qr: 1
  • debug: 1
• macosx1015-64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-07-18&endday=2022-07-24&tree=all

Comment 3

[Jeff Muizelaar [:jrmuizel]]

Attachment: Bug 1780717. Lower concealedSamples threshold to 0 to avoid intermittents.

Also add some additional conditions to make sure the values make
sense.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a01b807292a1
Lower concealedSamples threshold to 0 to avoid intermittents. r=ng

Comment 5

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/a01b807292a1

Comment 7

[Cristian Tuns]

This is still happening on autoland: https://treeherder.mozilla.org/logviewer?job_id=385541855&repo=autoland
Jeff can you please take a look?

Comment 8

[Jeff Muizelaar [:jrmuizel]]

Attachment: Bug 1780717. Drop the jitterBufferEmittedCount to 7.

This should fix an intermittent on Android.

Comment 9

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1780282

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/957917025056
Drop the jitterBufferEmittedCount to 7. r=ng

Comment 11

[Cristina Cozmuta (:CrissCozmuta)]

https://hg.mozilla.org/mozilla-central/rev/957917025056

Comment 12

[Intermittent Failures Robot]

19 failures in 3245 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• mozilla-central: 7

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 7
  • debug: 7
• android-em-7-0-x86_64-qr: 12
  • debug: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-07-25&endday=2022-07-31&tree=all

Comment 14

[Iulian Moraru]

This is still happening: https://treeherder.mozilla.org/jobs?repo=autoland&group_state=expanded&resultStatus=pending%2Crunning%2Csuccess%2Ctestfailed%2Cbusted%2Cexception%2Crunnable&searchStr=android%2C7.0%2Cx86-64%2Cwebrender%2Cdebug%2Cmochitests%2Cwith%2Csocket%2Cprocess%2Cwithout%2Cfission%2Cenabled%2Ctest-android-em-7.0-x86_64-qr%2Fdebug-geckoview-mochitest-media-spi-nofis%2Cmda&revision=94e7a44f0d1667d73fc57e7639f819a475dc26ae&selectedTaskRun=J-25Msc8Qvagfb-4_sLgjQ.0
Hi Jeff! Can you please take another look at this?
Thank you!

Comment 15

[Intermittent Failures Robot]

5 failures in 3339 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-08-08&endday=2022-08-14&tree=all

Comment 16

[Intermittent Failures Robot]

9 failures in 2916 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 9
  • debug: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-08-15&endday=2022-08-21&tree=all

Comment 17

[Intermittent Failures Robot]

6 failures in 3293 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 4
  • debug: 4
• android-hw-p2-8-0-android-aarch64-qr: 1
  • debug: 1
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-08-22&endday=2022-08-28&tree=all

Comment 18

[Intermittent Failures Robot]

10 failures in 3537 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1
• autoland: 7
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-tsan-qr: 1
  • opt: 1
• android-em-7-0-x86_64-qr: 9
  • debug: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-08-29&endday=2022-09-04&tree=all

Comment 19

[Intermittent Failures Robot]

10 failures in 3616 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 10
  • debug: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-09-05&endday=2022-09-11&tree=all

Comment 20

[Intermittent Failures Robot]

4 failures in 3023 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 3

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug: 1
• linux1804-64-tsan-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-09-12&endday=2022-09-18&tree=all

Comment 21

[Intermittent Failures Robot]

6 failures in 2909 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 4
  • debug: 4
• android-hw-p2-8-0-android-aarch64-qr: 1
  • debug: 1
• linux1804-64-tsan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-09-19&endday=2022-09-25&tree=all

Comment 22

[Intermittent Failures Robot]

5 failures in 2041 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-09-26&endday=2022-10-02&tree=all

Comment 23

[Intermittent Failures Robot]

8 failures in 2449 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-10-03&endday=2022-10-09&tree=all

Comment 24

[Intermittent Failures Robot]

6 failures in 3034 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 6
  • debug: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-10-10&endday=2022-10-16&tree=all

Comment 25

[Intermittent Failures Robot]

16 failures in 2793 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 15
  • debug: 15
• android-hw-p2-8-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-10-17&endday=2022-10-23&tree=all

Comment 26

[Intermittent Failures Robot]

4 failures in 3743 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • debug: 3
• android-hw-p2-8-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-10-24&endday=2022-10-30&tree=all

Comment 27

[Intermittent Failures Robot]

4 failures in 3626 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-10-31&endday=2022-11-06&tree=all

Comment 28

[Intermittent Failures Robot]

11 failures in 3445 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 10
  • debug: 10
• android-hw-p2-8-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-11-07&endday=2022-11-13&tree=all

Comment 29

[Intermittent Failures Robot]

8 failures in 3589 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-11-14&endday=2022-11-20&tree=all

Comment 30

[Intermittent Failures Robot]

2 failures in 3888 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-11-21&endday=2022-11-27&tree=all

Comment 31

[Intermittent Failures Robot]

8 failures in 3938 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-11-28&endday=2022-12-04&tree=all

Comment 32

[Intermittent Failures Robot]

8 failures in 3510 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 7
  • debug: 7
• android-hw-p2-8-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-12-05&endday=2022-12-11&tree=all

Comment 33

[Intermittent Failures Robot]

11 failures in 3558 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 11

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 11
  • debug: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-12-12&endday=2022-12-18&tree=all

Comment 34

[Intermittent Failures Robot]

4 failures in 2999 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-12-19&endday=2022-12-25&tree=all

Comment 35

[Intermittent Failures Robot]

6 failures in 1328 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 5
  • debug: 5
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2022-12-26&endday=2023-01-01&tree=all

Comment 36

[Intermittent Failures Robot]

6 failures in 2607 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 3

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 4
  • debug: 4
• android-hw-p5-13-0-android-aarch64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-01-02&endday=2023-01-08&tree=all

Comment 37

[Intermittent Failures Robot]

6 failures in 3530 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 2
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 5
  • debug: 5
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-01-09&endday=2023-01-15&tree=all

Comment 38

[Intermittent Failures Robot]

12 failures in 3717 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 12
  • debug: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-01-16&endday=2023-01-22&tree=all

Comment 39

[Intermittent Failures Robot]

8 failures in 3914 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-01-23&endday=2023-01-29&tree=all

Comment 40

[Intermittent Failures Robot]

10 failures in 3606 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 7

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 10
  • debug: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-01-30&endday=2023-02-05&tree=all

Comment 41

[Intermittent Failures Robot]

6 failures in 3766 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 6
  • debug: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-02-06&endday=2023-02-12&tree=all

Comment 42

[Intermittent Failures Robot]

11 failures in 3856 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 10
  • debug: 10
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-02-13&endday=2023-02-19&tree=all

Comment 43

[Intermittent Failures Robot]

10 failures in 3643 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 8

Platform and build breakdown:

• android-hw-p5-13-0-android-aarch64-qr: 2
  • debug: 2
• android-em-7-0-x86_64-qr: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-02-20&endday=2023-02-26&tree=all

Comment 44

[Intermittent Failures Robot]

4 failures in 3752 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-02-27&endday=2023-03-05&tree=all

Comment 45

[Intermittent Failures Robot]

16 failures in 3966 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-central: 2

Platform and build breakdown:

• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 15
  • debug: 15

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-03-06&endday=2023-03-12&tree=all

Comment 46

[Intermittent Failures Robot]

8 failures in 3761 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• elm: 1
• autoland: 6
• mozilla-central: 1

Platform and build breakdown:

• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 7
  • debug: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-03-13&endday=2023-03-19&tree=all

Comment 47

[Intermittent Failures Robot]

4 failures in 4161 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform and build breakdown:

• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-03-20&endday=2023-03-26&tree=all

Comment 48

[Intermittent Failures Robot]

4 failures in 3863 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-03-27&endday=2023-04-02&tree=all

Comment 49

[Intermittent Failures Robot]

5 failures in 3386 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-04-03&endday=2023-04-09&tree=all

Comment 50

[Intermittent Failures Robot]

8 failures in 3206 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 8
  • debug: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-04-10&endday=2023-04-16&tree=all

Comment 51

[Intermittent Failures Robot]

12 failures in 4004 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 12
  • debug: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-04-17&endday=2023-04-23&tree=all

Comment 52

[Intermittent Failures Robot]

10 failures in 3177 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 9
  • debug: 9
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-04-24&endday=2023-04-30&tree=all

Comment 53

[Intermittent Failures Robot]

5 failures in 3411 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 2

Platform and build breakdown:

• android-hw-p5-13-0-android-aarch64-qr: 2
  • debug: 2
• android-em-7-0-x86_64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-05-01&endday=2023-05-07&tree=all

Comment 54

[Intermittent Failures Robot]

14 failures in 4077 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 14
  • debug: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-05-08&endday=2023-05-14&tree=all

Comment 55

[Intermittent Failures Robot]

10 failures in 3578 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 6
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • debug: 3
• android-hw-p5-13-0-android-aarch64-qr: 2
  • debug: 2
• windows11-32-2009-qr: 2
  • debug: 2
• windows11-64-2009-asan-qr: 1
  • opt: 1
• windows11-64-2009-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-05-15&endday=2023-05-21&tree=all

Comment 56

[Intermittent Failures Robot]

20 failures in 3946 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7
• autoland: 13

Platform and build breakdown:

• windows11-64-2009-asan-qr: 6
  • opt: 6
• windows11-32-2009-qr: 5
  • debug: 5
• windows11-64-2009-qr: 4
  • debug: 4
• android-em-7-0-x86_64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-05-22&endday=2023-05-28&tree=all

Comment 57

[Intermittent Failures Robot]

21 failures in 3471 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 17
• mozilla-central: 2
• try: 2

Platform and build breakdown:

• windows11-32-2009-qr: 7
  • debug: 7
• windows11-64-2009-asan-qr: 3
  • opt: 3
• android-em-7-0-x86_64-qr: 3
  • debug: 3
• windows11-64-2009-qr: 7
  • debug: 7
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-05-29&endday=2023-06-04&tree=all

Comment 58

[Intermittent Failures Robot]

22 failures in 3885 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• mozilla-central: 5
• autoland: 13
• mozilla-beta: 1

Platform and build breakdown:

• windows11-64-2009-qr: 9
  • debug: 9
• windows11-64-2009-asan-qr: 3
  • opt: 3
• windows11-32-2009-qr: 6
  • debug: 6
• android-em-7-0-x86_64-qr: 3
  • debug: 3
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-06-05&endday=2023-06-11&tree=all

Comment 59

[Byron Campen [:bwc]]

This has gotten really bad lately:

https://treeherder.mozilla.org/jobs?repo=try&revision=ca7afc27d836c9d97bcb08ab2bcf32687765fab1

Do we have any insight into what caused this uptick in failures?

Comment 60

[Nico Grunbaum [:ng, @chew:mozilla.org]]

The bugs need some demuxing.

For the qpSum failure, which seems new, the timing corresponds with the libwebrtc landing. Looking at some of the logs[-1], it seems that one of the simulcast layers has a qpSum of 0. I am not an expert on VP8, but the expected range of that value is 1 to 127 inclusive. Looking at the code [0] 0 is not the default internal value, and it indicates that this value is coming from the encoder. Our last libvpx update was 2023/05/12, and is not indicated. Should the qpSum be copied down from the highest simulcast layer? Byron, from your link, this seems to be a Windows only issue. Can you confirm or deny that? Andreas, do you have any thoughts?

[-1] https://treeherder.mozilla.org/logviewer?job_id=419063105&repo=try&lineNumber=65472
[0] https://searchfox.org/mozilla-central/rev/962a843f6d96283c45162c788dc72bf217fca7df/third_party/libwebrtc/video/send_statistics_proxy.cc#996-999

Comment 61

[Intermittent Failures Robot]

25 failures in 4079 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 17
• mozilla-central: 6
• try: 2

Platform and build breakdown:

• windows11-64-2009-qr: 11
  • debug: 11
• android-em-7-0-x86_64-qr: 6
  • debug: 6
• windows11-32-2009-qr: 6
  • debug: 6
• windows11-64-2009-asan-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-06-12&endday=2023-06-18&tree=all

Comment 62

[Intermittent Failures Robot]

25 failures in 3880 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 19
• try: 2
• mozilla-central: 4

Platform and build breakdown:

• windows11-64-2009-qr: 9
  • debug: 9
• windows11-32-2009-qr: 11
  • debug: 11
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1
• windows11-64-2009-asan-qr: 1
  • opt: 1
• android-em-7-0-x86_64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-06-19&endday=2023-06-25&tree=all

Comment 63

[Intermittent Failures Robot]

20 failures in 3594 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 10
• autoland: 10

Platform and build breakdown:

• windows11-64-2009-qr: 13
  • debug: 13
• android-em-7-0-x86_64-qr: 3
  • debug: 3
• windows11-64-2009-asan-qr: 2
  • opt: 2
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1
• windows11-32-2009-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-06-26&endday=2023-07-02&tree=all

Comment 64

[Intermittent Failures Robot]

35 failures in 2956 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 10
• autoland: 23
• try: 2

Platform and build breakdown:

• windows11-32-2009-qr: 7
  • debug: 7
• windows11-64-2009-qr: 4
  • debug: 4
• windows11-64-2009-asan-qr: 24
  • opt: 24

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-07-03&endday=2023-07-09&tree=all

Comment 65

[Intermittent Failures Robot]

15 failures in 647 pushes (0.023 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• try: 1
• mozilla-central: 2

Platform and build breakdown:

• windows11-64-2009-asan-qr: 10
  • opt: 10
• windows11-64-2009-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-07-11&endday=2023-07-11&tree=all

Comment 66

[Natalia Csoregi [:nataliaCs]]

Update

There have been 54 failures within the last 7 days:

• 1 failure on Android 7.0 x86-64 WebRender debug
• 1 failure on Windows 11 x86 22H2 WebRender debug
• 44 failures on Windows 11 x64 22H2 asan WebRender opt
• 8 failures on Windows 11 x64 22H2 WebRender debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=422476325&repo=autoland&lineNumber=67131

[task 2023-07-13T01:32:44.812Z] 01:32:44     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.packetsReceived is a sane number for a short video test. value=231 
[task 2023-07-13T01:32:44.813Z] 01:32:44     INFO - Buffered messages finished
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.packetsDiscarded is sane number for a short test. value=119 
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:424:16
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - pedanticChecks/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:529:9
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - pedanticChecks@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:352:10
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - PC_LOCAL_TEST_LOCAL_STATS/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1622:19
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - promise callback*PC_LOCAL_TEST_LOCAL_STATS@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1620:46
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - execute/</<@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1087:32
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - promise callback*execute/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1085:21
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - execute@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1080:8
[task 2023-07-13T01:32:44.814Z] 01:32:44     INFO - PeerConnectionTest.prototype.run@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:556:22
[task 2023-07-13T01:32:44.816Z] 01:32:44     INFO - @https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html:37:14
[task 2023-07-13T01:32:44.816Z] 01:32:44     INFO - async*runNetworkTest/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2492:11
[task 2023-07-13T01:32:44.816Z] 01:32:44     INFO - async*runTestWhenReady@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:503:11
[task 2023-07-13T01:32:44.816Z] 01:32:44     INFO - async*runNetworkTest@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2489:9
[task 2023-07-13T01:32:44.816Z] 01:32:44     INFO - async*@https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html:15:15

Comment 67

[Intermittent Failures Robot]

62 failures in 3309 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #14 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 46
• mozilla-central: 11
• try: 3
• mozilla-beta: 2

Platform and build breakdown:

• windows11-64-2009-asan-qr: 44
  • opt: 44
• windows11-64-2009-qr: 12
  • debug: 12
• android-em-7-0-x86_64-qr: 3
  • debug: 3
• windows11-32-2009-qr: 2
  • debug: 2
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-07-10&endday=2023-07-16&tree=all

Comment 68

[Cristina Horotan [:chorotan]]

There have been 66 [total failures]https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2023-07-17&endday=2023-07-24&tree=trunk&bug=1780717) in the last 7 days.
There are:

• 3 failures on android-em-7-0-x86_64-qr debug
• 1 failure on android-hw-p5-13-0-android-aarch64-qr debug
• 4 failures on windows11-32-2009-qr debug
• 47 failures on windows11-64-2009-asan-qr opt
• 11 failures on windows11-64-2009-qr debug

Recent failure log.

Jan, as the owner of this component, can you help us assign the bug to someone? Thank you.

Comment 69

[Intermittent Failures Robot]

65 failures in 3520 pushes (0.018 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 39
• mozilla-central: 25
• try: 1

Platform and build breakdown:

• windows11-64-2009-qr: 11
  • debug: 11
• windows11-64-2009-asan-qr: 47
  • opt: 47
• android-em-7-0-x86_64-qr: 3
  • debug: 3
• windows11-32-2009-qr: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-07-17&endday=2023-07-23&tree=all

Comment 70

[Cristina Horotan [:chorotan]]

Attachment: Bug 1780717 - disable test_peerConnection_stats.html on win 11 for frequent failures. r=#intermittent-reviewers

Comment 71

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/cfcd183fdaf2
disable test_peerConnection_stats.html on win 11 for frequent failures. r=intermittent-reviewers,MasterWayZ

Comment 72

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/cfcd183fdaf2

Comment 73

[Iulian Moraru]

Reopening this because it was just a disable patch that landed. It was missing the "leave-open" in the keywords, that is why it got closed.

Comment 74

[Byron Campen [:bwc]]

Failures related to jitterBufferEmittedCount seem to happen only on android, but all the other failures (packetsDiscarded, discardedPackets, framesDropped) seem to happen only on windows. The first windows failure I see happened on 2023-05-19, which lines up with the libvpx update mentioned in comment 60.

Comment 75

[Intermittent Failures Robot]

45 failures in 3403 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #19 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 27
• mozilla-central: 16
• try: 2

Platform and build breakdown:

• windows11-64-2009-asan-qr: 31
  • opt: 31
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 4
  • debug: 4
• windows11-64-2009-qr: 5
  • debug: 5
• windows11-32-2009-qr: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-07-24&endday=2023-07-30&tree=all

Comment 76

[Serban Stanca [:SerbanS]]

Attachment: Bug 1780717 - disable test_peerConnection_stats.html on windows for causing frequent failures. r=#intermittent-reviewers

Comment 77

[Serban Stanca [:SerbanS]]

I made another disable patch as it continued to fail on the targeted platform.

Comment 78

[Intermittent Failures Robot]

16 failures in 679 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 2

Platform and build breakdown:

• windows11-64-2009-qr: 4
  • debug: 4
• windows11-64-2009-asan-qr: 11
  • opt: 11
• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-08-02&endday=2023-08-02&tree=all

Comment 79

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b04b9d929f31
disable test_peerConnection_stats.html on windows for causing frequent failures. r=intermittent-reviewers,jmaher DONTBUILD

Comment 80

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/b04b9d929f31

Comment 81

[Intermittent Failures Robot]

72 failures in 3276 pushes (0.022 failures/push) were associated with this bug in the last 7 days.

This is the #17 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 51
• mozilla-central: 16
• try: 2
• mozilla-beta: 3

Platform and build breakdown:

• windows11-32-2009-qr: 4
  • debug: 4
• windows11-64-2009-asan-qr: 51
  • opt: 51
• windows11-64-2009-qr: 13
  • debug: 13
• android-em-7-0-x86_64-qr: 3
  • debug: 3
• android-em-7-0-x86_64-shippable-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-07-31&endday=2023-08-06&tree=all

Comment 82

[Intermittent Failures Robot]

12 failures in 3341 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-beta: 4
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 7
  • debug: 7
• windows11-64-2009-asan-qr: 3
  • opt: 3
• windows11-64-2009-qr: 1
  • debug: 1
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-08-07&endday=2023-08-13&tree=all

Comment 83

[Intermittent Failures Robot]

8 failures in 3076 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 1
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 7
  • debug: 7
• windows11-64-2009-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-08-14&endday=2023-08-20&tree=all

Comment 84

[Intermittent Failures Robot]

8 failures in 2218 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 7
  • debug: 7
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-08-21&endday=2023-08-27&tree=all

Comment 85

[Intermittent Failures Robot]

8 failures in 3019 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 6
  • debug: 6
• android-hw-p5-13-0-android-aarch64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-08-28&endday=2023-09-03&tree=all

Comment 86

[Intermittent Failures Robot]

5 failures in 3267 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 5
  • debug: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-09-04&endday=2023-09-10&tree=all

Comment 87

[Intermittent Failures Robot]

9 failures in 3337 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 5
  • debug: 5
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1
• android-hw-p5-13-0-android-aarch64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-09-11&endday=2023-09-17&tree=all

Comment 88

[Intermittent Failures Robot]

9 failures in 3850 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 5

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1
• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-qr: 6
  • debug: 6
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-09-18&endday=2023-09-24&tree=all

Comment 89

[Intermittent Failures Robot]

9 failures in 3726 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 9
  • debug: 8
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-09-25&endday=2023-10-01&tree=all

Comment 90

[Intermittent Failures Robot]

44 failures in 4018 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #32 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 25
• mozilla-central: 14
• try: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 28
  • debug: 28
• linux1804-64-asan-qr: 9
  • opt: 9
• linux1804-64-qr: 7
  • debug: 6
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-10-02&endday=2023-10-08&tree=all

Comment 91

[Intermittent Failures Robot]

15 failures in 618 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-central: 4

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 11
  • debug: 11
• linux1804-64-qr: 3
  • debug: 3
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-10-09&endday=2023-10-09&tree=all

Comment 92

[Natalia Csoregi [:nataliaCs]]

Update

There have been 52 total failures within the last 7 days:

• 35 failures on Android 7.0 x86-64 WebRender debug
• 8 failures on Linux 18.04 x64 WebRender asan opt
• 9 failures on Linux 18.04 x64 WebRender debug/opt

Recent log: https://treeherder.mozilla.org/logviewer?job_id=431953147&repo=mozilla-central&lineNumber=94689

[task 2023-10-10T10:53:12.874Z] 10:53:12     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.jitterBufferEmittedCount is a sane number for a short video test. value=111 
[task 2023-10-10T10:53:12.878Z] 10:53:12     INFO - Buffered messages finished
[task 2023-10-10T10:53:12.881Z] 10:53:12     INFO - TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.jitterBufferDelay is a sane number for a short video test. value=0.09932099999999999/111=0.0008947837837837838 
[task 2023-10-10T10:53:12.881Z] 10:53:12     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:426:16
[task 2023-10-10T10:53:12.883Z] 10:53:12     INFO - pedanticChecks/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:588:9
[task 2023-10-10T10:53:12.883Z] 10:53:12     INFO - pedanticChecks@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:352:10
[task 2023-10-10T10:53:12.884Z] 10:53:12     INFO - PC_LOCAL_TEST_LOCAL_STATS/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1622:19
[task 2023-10-10T10:53:12.885Z] 10:53:12     INFO - promise callback*PC_LOCAL_TEST_LOCAL_STATS@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1620:46
[task 2023-10-10T10:53:12.886Z] 10:53:12     INFO - execute/</<@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1086:32
[task 2023-10-10T10:53:12.886Z] 10:53:12     INFO - promise callback*execute/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1084:21
[task 2023-10-10T10:53:12.891Z] 10:53:12     INFO - execute@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1079:8
[task 2023-10-10T10:53:12.892Z] 10:53:12     INFO - PeerConnectionTest.prototype.run@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:556:22
[task 2023-10-10T10:53:12.893Z] 10:53:12     INFO - @https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html:37:14
[task 2023-10-10T10:53:12.893Z] 10:53:12     INFO - async*runNetworkTest/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2492:11
[task 2023-10-10T10:53:12.894Z] 10:53:12     INFO - async*runTestWhenReady@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:502:11
[task 2023-10-10T10:53:12.894Z] 10:53:12     INFO - async*runNetworkTest@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2489:9
[task 2023-10-10T10:53:12.898Z] 10:53:12     INFO - async*@https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html:15:15
[task 2023-10-10T10:53:12.902Z] 10:53:12     INFO - TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field totalSamplesReceived when kind is not 'audio' 

Jeff, do you have time to check this out?
Thank you

Comment 93

[Intermittent Failures Robot]

70 failures in 3764 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #17 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 50
• mozilla-central: 19
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 40
  • debug: 40
• linux1804-64-qr: 14
  • debug: 13
  • opt: 1
• linux1804-64-asan-qr: 15
  • opt: 15
• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-10-09&endday=2023-10-15&tree=all

Comment 94

[Intermittent Failures Robot]

45 failures in 3484 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #24 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 19
• mozilla-beta: 1
• autoland: 24
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 31
  • debug: 31
• linux1804-64-asan-qr: 6
  • opt: 6
• linux1804-64-qr: 3
  • debug: 3
• linux1804-64-ccov-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-10-16&endday=2023-10-22&tree=all

Comment 95

[Intermittent Failures Robot]

61 failures in 3657 pushes (0.017 failures/push) were associated with this bug in the last 7 days.

This is the #22 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 38
• elm: 1
• mozilla-central: 19
• try: 3

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 38
  • debug: 38
• linux1804-64-asan-qr: 14
  • opt: 14
• linux1804-64-qr: 6
  • opt: 1
  • debug: 5
• linux1804-64-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-10-23&endday=2023-10-29&tree=all

Comment 96

[Iulian Moraru]

Update:
There have been 58 failures within the last 7 days:
• 38 failures on Android 7.0 x86-64 WebRender debug
• 10 failures on Linux 18.04 x64 WebRender asan opt
• 4 failures on Linux 18.04 x64 CCov WebRender opt
• 6 failures on Linux 18.04 x64 WebRender debug
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=434359622&repo=autoland&lineNumber=5598

[task 2023-10-30T23:32:29.886Z] 23:32:29     INFO -  TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.jitterBufferEmittedCount is a sane number for a short video test. value=39
[task 2023-10-30T23:32:29.886Z] 23:32:29     INFO -  Buffered messages finished
[task 2023-10-30T23:32:29.886Z] 23:32:29  WARNING -  TEST-UNEXPECTED-FAIL | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp.jitterBufferDelay is a sane number for a short video test. value=0.037152/39=0.0009526153846153845
[task 2023-10-30T23:32:29.886Z] 23:32:29     INFO -  SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:426:16
[task 2023-10-30T23:32:29.886Z] 23:32:29     INFO -  pedanticChecks/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:588:9
[task 2023-10-30T23:32:29.886Z] 23:32:29     INFO -  pedanticChecks@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:352:10
[task 2023-10-30T23:32:29.886Z] 23:32:29     INFO -  PC_REMOTE_TEST_REMOTE_STATS/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1637:19
[task 2023-10-30T23:32:29.886Z] 23:32:29     INFO -  promise callback*PC_REMOTE_TEST_REMOTE_STATS@https://example.com/tests/dom/media/webrtc/tests/mochitests/stats.js:1635:47
[task 2023-10-30T23:32:29.886Z] 23:32:29     INFO -  execute/</<@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1086:32
[task 2023-10-30T23:32:29.887Z] 23:32:29     INFO -  promise callback*execute/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1084:21
[task 2023-10-30T23:32:29.887Z] 23:32:29     INFO -  execute@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:1079:8
[task 2023-10-30T23:32:29.887Z] 23:32:29     INFO -  PeerConnectionTest.prototype.run@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:556:22
[task 2023-10-30T23:32:29.887Z] 23:32:29     INFO -  @https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html:37:14
[task 2023-10-30T23:32:29.887Z] 23:32:29     INFO -  async*runNetworkTest/<@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2492:11
[task 2023-10-30T23:32:29.887Z] 23:32:29     INFO -  async*runTestWhenReady@https://example.com/tests/dom/media/webrtc/tests/mochitests/head.js:502:11
[task 2023-10-30T23:32:29.887Z] 23:32:29     INFO -  async*runNetworkTest@https://example.com/tests/dom/media/webrtc/tests/mochitests/pc.js:2489:9
[task 2023-10-30T23:32:29.887Z] 23:32:29     INFO -  async*@https://example.com/tests/dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html:15:15
[task 2023-10-30T23:32:29.888Z] 23:32:29     INFO -  TEST-PASS | dom/media/webrtc/tests/mochitests/test_peerConnection_stats.html | inbound-rtp does not have field totalSamplesReceived when kind is not 'audio'

Comment 97

[Iulian Moraru]

Hi Jeff! Can you please take another look at this? Maybe we can avoid more disables on this test.
Thank you!

Comment 98

[Byron Campen [:bwc]]

Attachment: Bug 1780717: Allow smaller average jitter buffer delay in this test. r?ng

Depends on D192609

Comment 99

[Intermittent Failures Robot]

15 failures in 657 pushes (0.023 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 9
• mozilla-central: 3
• mozilla-beta: 3

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 10
  • debug: 10
• linux1804-64-asan-qr: 3
  • opt: 3
• linux1804-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-11-02&endday=2023-11-02&tree=all

Comment 100

[Intermittent Failures Robot]

68 failures in 3356 pushes (0.02 failures/push) were associated with this bug in the last 7 days.

This is the #16 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 40
• mozilla-central: 18
• try: 4
• mozilla-beta: 6

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 46
  • debug: 46
• linux1804-64-ccov-qr: 1
  • opt: 1
• linux1804-64-qr: 8
  • debug: 8
• linux1804-64-asan-qr: 13
  • opt: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-10-30&endday=2023-11-05&tree=all

Comment 101

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3b68fa2b102f
Allow smaller average jitter buffer delay in this test. r=ng

Comment 102

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/3b68fa2b102f

Comment 103

[Intermittent Failures Robot]

20 failures in 3288 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-beta: 5
• autoland: 14
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 7
  • opt: 7
• android-em-7-0-x86_64-qr: 10
  • debug: 10
• linux1804-64-qr: 2
  • debug: 2
• linux1804-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-11-06&endday=2023-11-12&tree=all

Comment 104

[Byron Campen [:bwc]]

Looks a lot better over the last few days. Might be worth uplifting to beta. Needinfo self to check back on this.

Comment 105

[Intermittent Failures Robot]

1 failures in 3495 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-11-13&endday=2023-11-19&tree=all

Comment 106

[Intermittent Failures Robot]

1 failures in 4108 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-11-27&endday=2023-12-03&tree=all

Comment 107

[Intermittent Failures Robot]

2 failures in 3671 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2

Platform and build breakdown:

• linux1804-64-asan-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-12-04&endday=2023-12-10&tree=all

Comment 108

[Intermittent Failures Robot]

1 failures in 3349 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2023-12-18&endday=2023-12-24&tree=all

Comment 109

[Intermittent Failures Robot]

1 failures in 2274 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-01-01&endday=2024-01-07&tree=all

Comment 110

[Intermittent Failures Robot]

2 failures in 3217 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 2
  • debug: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-01-08&endday=2024-01-14&tree=all

Comment 111

[Intermittent Failures Robot]

2 failures in 3599 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• pine: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-01-15&endday=2024-01-21&tree=all

Comment 112

[Intermittent Failures Robot]

3 failures in 4034 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1
• android-em-7-0-x86_64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-01-22&endday=2024-01-28&tree=all

Comment 113

[Intermittent Failures Robot]

2 failures in 3952 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• pine: 1
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-01-29&endday=2024-02-04&tree=all

Comment 114

[Intermittent Failures Robot]

1 failures in 4009 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-02-05&endday=2024-02-11&tree=all

Comment 115

[Intermittent Failures Robot]

2 failures in 3382 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform and build breakdown:

• android-hw-p5-13-0-android-aarch64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-02-19&endday=2024-02-25&tree=all

Comment 116

[Lauren Hall]

Attachment: same problem

Thanks from sorenrare1980.

Comment 117

[Intermittent Failures Robot]

5 failures in 4052 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • debug: 3
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-02-26&endday=2024-03-03&tree=all

Comment 118

[Intermittent Failures Robot]

4 failures in 4198 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • debug: 3
• android-em-7-0-x86_64-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-03-04&endday=2024-03-10&tree=all

Comment 119

[Intermittent Failures Robot]

3 failures in 3849 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug: 1
• android-em-7-0-x86_64-lite-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-03-11&endday=2024-03-17&tree=all

Comment 120

[Intermittent Failures Robot]

8 failures in 3791 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 1
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-qr: 4
  • debug: 4
• android-em-7-0-x86_64-qr: 4
  • debug: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-03-18&endday=2024-03-24&tree=all

Comment 121

[Intermittent Failures Robot]

5 failures in 3590 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-esr115: 1
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • debug: 3
• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-03-25&endday=2024-03-31&tree=all

Comment 122

[Intermittent Failures Robot]

8 failures in 3805 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 2
• mozilla-beta: 1

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-qr: 3
  • debug: 3
• macosx1015-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-04-01&endday=2024-04-07&tree=all

Comment 123

[Intermittent Failures Robot]

4 failures in 3235 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 2
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • debug: 3
• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780717&startday=2024-04-08&endday=2024-04-14&tree=all