1667147 - Perma TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/report-only-auto.tentative.html | font-display-late-swap Report Format - expected FAIL when Gecko 83 merges to Beta on 2020-10-19

Status: VERIFIED FIXED

(Testing :: web-platform-tests, defect)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

[Tracking Requested - why for this release]:

central-as-beta simulation: https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&selectedTaskRun=GzLlP-CERIOkqlkWDQsOGw.0&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=fe26df9ba01855cafb14cd113e2f328b4e345d00&searchStr=wpt

Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=316574032&repo=try

11609 11:57:11 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/report-only-auto.tentative.html | font-display-late-swap Report Format - expected FAIL
11611 11:57:11 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/report-only-auto.tentative.html | ReferenceError: ReportingObserver is not defined
12134 11:57:50 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/report-only-blank.tentative.html | font-display-late-swap Report Format - expected FAIL
12136 11:57:50 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/report-only-blank.tentative.html | ReferenceError: ReportingObserver is not defined
12711 11:58:29 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/report-only-block.tentative.html | font-display-late-swap Report Format - expected FAIL
12713 11:58:29 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/report-only-block.tentative.html | ReferenceError: ReportingObserver is not defined
13214 11:59:09 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/report-only-fallback.tentative.html | font-display-late-swap Report Format - expected PASS
13215 11:59:09 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/report-only-fallback.tentative.html | ReferenceError: ReportingObserver is not defined
13752 11:59:48 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/report-only-optional.tentative.html | font-display-late-swap Report Format - expected PASS
13753 11:59:48 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/report-only-optional.tentative.html | ReferenceError: ReportingObserver is not defined
13981 12:00:28 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/report-only-swap.tentative.html | font-display-late-swap Report Format - expected FAIL
13983 12:00:28 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/report-only-swap.tentative.html | ReferenceError: ReportingObserver is not defined
14084 12:01:05 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/reporting-auto.tentative.html | font-display-late-swap Report Format - expected FAIL
14086 12:01:05 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/reporting-auto.tentative.html | ReferenceError: ReportingObserver is not defined
14183 12:01:42 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/reporting-blank.tentative.html | font-display-late-swap Report Format - expected FAIL
14185 12:01:42 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/reporting-blank.tentative.html | ReferenceError: ReportingObserver is not defined
14285 12:02:20 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/reporting-block.tentative.html | font-display-late-swap Report Format - expected FAIL
14287 12:02:20 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/reporting-block.tentative.html | ReferenceError: ReportingObserver is not defined
14386 12:02:57 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/reporting-fallback.tentative.html | font-display-late-swap Report Format - expected PASS
14387 12:02:57 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/reporting-fallback.tentative.html | ReferenceError: ReportingObserver is not defined
14486 12:03:35 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/reporting-optional.tentative.html | font-display-late-swap Report Format - expected PASS
14487 12:03:35 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/reporting-optional.tentative.html | ReferenceError: ReportingObserver is not defined
14591 12:04:12 INFO - TEST-UNEXPECTED-NOTRUN | /document-policy/font-display/reporting-swap.tentative.html | font-display-late-swap Report Format - expected FAIL
14593 12:04:12 INFO - TEST-UNEXPECTED-ERROR | /document-policy/font-display/reporting-swap.tentative.html | ReferenceError: ReportingObserver is not defined

Comment 1

[Intermittent Failures Robot]

1 failures in 4019 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux1804-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1667147&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Reporting observers are missing for the tests (only enabled for Nightly). Shall the pref be toggled for them or the test results set as accepted?

Comment 3

[Tom Tung [:tt, :ttung]]

Attachment: Bug 1667147 - Set dom.reporting.enabled to true for front-display tests;

Comment 4

[Tom Tung [:tt, :ttung]]

(In reply to Sebastian Hengst [:aryx] (needinfo on intermittent or backout) from comment #2)

Reporting observers are missing for the tests (only enabled for Nightly). Shall the pref be toggled for them or the test results set as accepted?

I think we should change the pref for them rather than setting the result as accepted since we might still have similar issues if someone changes these tests.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/7095b0f835ee
Set dom.reporting.enabled to true for front-display tests; r=aryx

Comment 6

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/7095b0f835ee

Comment 7

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Verified fixed with yesterday's central-as-beta simulation.