1769713 - Intermittent /screen-capture/getdisplaymedia.https.html | getDisplayMedia() must adhere to frameRate if set - assert_less_than_equal: expected a number less than or equal to 8.75 but got 8.88804841149773

Status: RESOLVED DUPLICATE of bug 1785381

(Core :: WebRTC: Audio/Video, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ccozmuta [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=378311868&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/c9vaZtBiRGCrPavcaJI9Dg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/c9vaZtBiRGCrPavcaJI9Dg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2022-05-17T06:38:31.386Z] 06:38:31     INFO - TEST-START | /screen-capture/getdisplaymedia.https.html
[task 2022-05-17T06:38:31.387Z] 06:38:31     INFO - Run 1/10
[task 2022-05-17T06:38:31.387Z] 06:38:31     INFO - Closing window a1d8e82a-86de-4c4d-b022-f58463fc840b
[task 2022-05-17T06:38:35.052Z] 06:38:35     INFO - PID 1096 | 2022-05-17 06:38:35.051 firefox[1096:12966] Persistent UI failed to open file file:///Users/cltbld/Library/Saved%20Application%20State/org.mozilla.nightly.savedState/window_1.data: No such file or directory (2)
[task 2022-05-17T06:38:56.119Z] 06:38:56     INFO - 
[task 2022-05-17T06:38:56.119Z] 06:38:56     INFO - TEST-PASS | /screen-capture/getdisplaymedia.https.html | getDisplayMedia in navigator.mediaDevices 
[task 2022-05-17T06:38:56.119Z] 06:38:56     INFO - TEST-PASS | /screen-capture/getdisplaymedia.https.html | getDisplayMedia() must require user activation 
[task 2022-05-17T06:38:56.119Z] 06:38:56     INFO - TEST-UNEXPECTED-FAIL | /screen-capture/getdisplaymedia.https.html | getDisplayMedia() must adhere to frameRate if set - assert_less_than_equal: expected a number less than or equal to 8.75 but got 8.88804841149773
[task 2022-05-17T06:38:56.119Z] 06:38:56     INFO - @https://web-platform.test:8443/screen-capture/getdisplaymedia.https.html:55:25
[task 2022-05-17T06:38:56.135Z] 06:38:56     INFO - ......................................
[task 2022-05-17T06:38:56.135Z] 06:38:56     INFO - TEST-OK | /screen-capture/getdisplaymedia.https.html | took 24747ms
[task 2022-05-17T06:38:56.137Z] 06:38:56     INFO - PID 1096 | 1652769536123	Marionette	INFO	Stopped listening on port 49288
[task 2022-05-17T06:38:56.531Z] 06:38:56     INFO - PID 1096 | [2022-05-17T06:38:56Z ERROR xulstore::persist] removeDocument error: unavailable
[task 2022-05-17T06:38:56.551Z] 06:38:56     INFO - Browser exited with return code 0
[task 2022-05-17T06:38:56.554Z] 06:38:56     INFO - Closing logging queue
[task 2022-05-17T06:38:56.554Z] 06:38:56     INFO - queue closed
[task 2022-05-17T06:38:56.581Z] 06:38:56     INFO - Application command: /opt/worker/tasks/task_165276932543382/build/application/Firefox Nightly.app/Contents/MacOS/firefox --marionette about:blank -foreground -profile /var/folders/w5/76_r_zv503gc9rtmpdhtz5ym000014/T/tmporh8473s
[task 2022-05-17T06:38:56.587Z] 06:38:56     INFO - Starting runner
[task 2022-05-17T06:38:56.971Z] 06:38:56     INFO - PID 1131 | 1652769536970	Marionette	INFO	Marionette enabled
[task 2022-05-17T06:38:56.987Z] 06:38:56     INFO - PID 1131 | 1652769536986	Marionette	INFO	Listening on port 49303
[task 2022-05-17T06:38:57.864Z] 06:38:57     INFO - PID 1131 | console.warn: SearchSettings: "get: No settings file exists, new profile?" (new NotFoundError("Could not open the file at /var/folders/w5/76_r_zv503gc9rtmpdhtz5ym000014/T/tmporh8473s/search.json.mozlz4", (void 0)))
[task 2022-05-17T06:38:58.893Z] 06:38:58     INFO - TEST-START | /screen-capture/getdisplaymedia.https.html

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

:ng, since you are the author of the regressor, bug 1760843, could you take a look?
For more information, please visit auto_nag documentation.

Comment 2

[Norisz Fay [:noriszfay]]

This started failing on tier 1 as can be seen from this backfill range.

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1760843

Comment 4

[Nico Grunbaum [:ng, @chew:mozilla.org]]

It looks like this new test has revealed some inconsistency in the frame timing of screen capture on macOS. The test was added to verify the fix to a known regression in screen capture under windows. I do not think that addressing the macOS issue should be done in the same patch set, instead a new bug should be filed and the test should be disabled for macOS.

Comment 5

[Nico Grunbaum [:ng, @chew:mozilla.org]]

The way that the WPT checks for delivered frames is somewhat flawed for Firefox, there is the possibility that this failure is a false positive and the test will need to be altered.

Comment 6

[Intermittent Failures Robot]

33 failures in 667 pushes (0.049 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 31
• mozilla-central: 2

Platform and build breakdown:

• macosx1015-64-qr: 31
  • opt: 30
  • debug: 1
• macosx1015-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1769713&startday=2022-05-17&endday=2022-05-17&tree=all

Comment 7

[Andreea Pavel [:apavel]]

There are 46 total failures in the last 4 days on

• macosx1015-64-qr opt
• macosx1015-64-shippable-qr opt
  Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=378746221&repo=autoland&lineNumber=13611

[task 2022-05-20T09:40:37.668Z] 09:40:37     INFO - TEST-START | /screen-capture/getdisplaymedia.https.html
[task 2022-05-20T09:40:37.675Z] 09:40:37     INFO - Closing window 04690deb-53d4-4254-834d-ff2b7f4a00cf
[task 2022-05-20T09:41:02.711Z] 09:41:02     INFO - 
[task 2022-05-20T09:41:02.711Z] 09:41:02     INFO - TEST-PASS | /screen-capture/getdisplaymedia.https.html | getDisplayMedia in navigator.mediaDevices 
[task 2022-05-20T09:41:02.711Z] 09:41:02     INFO - TEST-PASS | /screen-capture/getdisplaymedia.https.html | getDisplayMedia() must require user activation 
[task 2022-05-20T09:41:02.711Z] 09:41:02     INFO - TEST-UNEXPECTED-FAIL | /screen-capture/getdisplaymedia.https.html | getDisplayMedia() must adhere to frameRate if set - assert_less_than_equal: expected a number less than or equal to 8.75 but got 8.932912007778318
[task 2022-05-20T09:41:02.711Z] 09:41:02     INFO - @https://web-platform.test:8443/screen-capture/getdisplaymedia.https.html:55:25
[task 2022-05-20T09:41:02.727Z] 09:41:02     INFO - ......................................
[task 2022-05-20T09:41:02.727Z] 09:41:02     INFO - TEST-OK | /screen-capture/getdisplaymedia.https.html | took 25047ms
[task 2022-05-20T09:41:02.729Z] 09:41:02     INFO - PID 2556 | 1653039662715	Marionette	INFO	Stopped listening on port 58643
[task 2022-05-20T09:41:03.159Z] 09:41:03     INFO - PID 2556 | [2022-05-20T09:41:03Z ERROR xulstore::persist] removeDocument error: unavailable
[task 2022-05-20T09:41:03.180Z] 09:41:03     INFO - Browser exited with return code 0
[task 2022-05-20T09:41:03.183Z] 09:41:03     INFO - Closing logging queue
[task 2022-05-20T09:41:03.183Z] 09:41:03     INFO - queue closed
[task 2022-05-20T09:41:03.205Z] 09:41:03     INFO - Application command: /opt/worker/tasks/task_165303866748124/build/application/Firefox Nightly.app/Contents/MacOS/firefox --marionette about:blank -foreground -profile /var/folders/6t/02hfsyn965q3rhg74bj2wt40000014/T/tmpem4ov_me
[task 2022-05-20T09:41:03.213Z] 09:41:03     INFO - PID 2575 | 1653039636839	Marionette	INFO	Marionette enabled
[task 2022-05-20T09:41:03.214Z] 09:41:03     INFO - PID 2575 | 1653039636881	Marionette	INFO	Listening on port 58668
[task 2022-05-20T09:41:03.214Z] 09:41:03     INFO - PID 2575 | console.warn: SearchSettings: "get: No settings file exists, new profile?" (new NotFoundError("Could not open the file at /var/folders/6t/02hfsyn965q3rhg74bj2wt40000014/T/tmp9b_ncf57/search.json.mozlz4", (void 0)))
[task 2022-05-20T09:41:03.215Z] 09:41:03     INFO - Starting runner
[task 2022-05-20T09:41:03.552Z] 09:41:03     INFO - PID 2575 | 2022-05-20 09:41:03.551 firefox[2575:70205] Persistent UI failed to open file file:///Users/cltbld/Library/Saved%20Application%20State/org.mozilla.nightly.savedState/window_1.data: No such file or directory (2)

Comment 8

[Andreea Pavel [:apavel]]

Attachment: Bug 1769713 - disable getdisplaymedia.https.html on mac r=ng

Comment 9

[Intermittent Failures Robot]

54 failures in 2694 pushes (0.02 failures/push) were associated with this bug in the last 7 days.

This is the #20 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 44
• mozilla-central: 7
• try: 3

Platform and build breakdown:

• macosx1015-64-qr: 45
  • opt: 44
  • debug: 1
• macosx1015-64-shippable-qr: 8
  • opt: 8
• macosx1015-64-devedition-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1769713&startday=2022-05-16&endday=2022-05-22&tree=all

Comment 10

[Intermittent Failures Robot]

6 failures in 2624 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 1

Platform and build breakdown:

• macosx1015-64-qr: 6
  • debug: 5
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1769713&startday=2022-05-23&endday=2022-05-29&tree=all

Comment 11

[Nico Grunbaum [:ng, @chew:mozilla.org]]

Andreea, would there be any harm in checking back on the numbers in a week before landing?

Comment 12

[Andreea Pavel [:apavel]]

(In reply to Nico Grunbaum [:ng, @chew:mozilla.org] from comment #11)

Andreea, would there be any harm in checking back on the numbers in a week before landing?

Hi, no. We'll revisit this in a week and see what happens until then. Thank you!

Comment 13

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1760843

Comment 14

[Intermittent Failures Robot]

3 failures in 3336 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform and build breakdown:

• macosx1015-64-qr: 3
  • debug: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1769713&startday=2022-06-06&endday=2022-06-12&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 3170 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1769713&startday=2022-06-13&endday=2022-06-19&tree=all

Comment 16

[Intermittent Failures Robot]

1 failures in 3075 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1769713&startday=2022-06-20&endday=2022-06-26&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 3312 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 1

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1769713&startday=2022-06-27&endday=2022-07-03&tree=all

Comment 18

[Intermittent Failures Robot]

2 failures in 3057 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr102: 2

Platform and build breakdown:

• macosx1015-64-qr: 2
  • debug: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1769713&startday=2022-08-01&endday=2022-08-07&tree=all