1581137 - Perma fail TEST-UNEXPECTED-PASS | image/test/browser/browser_offscreen_image_in_out_of_process_iframe.js | No frameUpdate should happen - Got 0, expected 0 when Gecko 71 merges to Beta on 2019-10-14

Status: VERIFIED FIXED

(Core :: Graphics: ImageLib, defect)

Description

[Bogdan Tara[:bogdan_tara | bogdant]]

Central as Beta simulation:

https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=266535764&revision=95c2c001e71c03669c0c19de81a7aa5574e5323b&searchStr=linux%2Cx64%2Cshippable%2Copt%2Cmochitests%2Ctest-linux64-shippable%2Fopt-mochitest-browser-chrome-e10s-4%2Cm%28bc4%29

https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=266530925&revision=95c2c001e71c03669c0c19de81a7aa5574e5323b&searchStr=os%2Cx%2C10.14%2Cdebug%2Cmochitests%2Ctest-macosx1014-64%2Fdebug-mochitest-browser-chrome-e10s-8%2Cm%28bc8%29

https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=266530633&revision=95c2c001e71c03669c0c19de81a7aa5574e5323b&searchStr=os%2Cx%2C10.14%2Cshippable%2Copt%2Cmochitests%2Ctest-macosx1014-64-shippable%2Fopt-mochitest-browser-chrome-e10s-2%2Cm%28bc2%29

https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=266531234&revision=95c2c001e71c03669c0c19de81a7aa5574e5323b&searchStr=os%2Cx%2C10.14%2Cdevedition%2Copt%2Cmochitests%2Ctest-macosx1014-64-devedition%2Fopt-mochitest-browser-chrome-e10s-1%2Cm%28bc1%29

https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=266530703&revision=95c2c001e71c03669c0c19de81a7aa5574e5323b&searchStr=windows%2C7%2Cdebug%2Cmochitests%2Ctest-windows7-32%2Fdebug-mochitest-browser-chrome-e10s-3%2Cm%28bc3%29

https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=266528541&revision=95c2c001e71c03669c0c19de81a7aa5574e5323b&searchStr=windows%2C7%2Cdevedition%2Copt%2Cmochitests%2Ctest-windows7-32-devedition%2Fopt-mochitest-browser-chrome-e10s-4%2Cm%28bc4%29

https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=266530897&revision=95c2c001e71c03669c0c19de81a7aa5574e5323b&searchStr=windows%2C10%2Cx64%2Cdebug%2Cmochitests%2Ctest-windows10-64%2Fdebug-mochitest-browser-chrome-e10s-7%2Cm%28bc7%29

https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=266531774&revision=95c2c001e71c03669c0c19de81a7aa5574e5323b&searchStr=windows%2C10%2Cx64%2Cshippable%2Copt%2Cmochitests%2Ctest-windows10-64-shippable%2Fopt-mochitest-browser-chrome-e10s-2%2Cm%28bc2%29

similar failures on the late beta

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=266535764&repo=try&lineNumber=5199

[task 2019-09-13T13:57:05.593Z] 13:57:05 INFO - TEST-START | image/test/browser/browser_offscreen_image_in_out_of_process_iframe.js
[task 2019-09-13T13:57:07.588Z] 13:57:07 INFO - Buffered messages logged at 13:57:05
[task 2019-09-13T13:57:07.588Z] 13:57:07 INFO - Entering test bound setup_pref
[task 2019-09-13T13:57:07.589Z] 13:57:07 INFO - Leaving test bound setup_pref
[task 2019-09-13T13:57:07.590Z] 13:57:07 INFO - Entering test bound
[task 2019-09-13T13:57:07.590Z] 13:57:07 INFO - Buffered messages finished
[task 2019-09-13T13:57:07.591Z] 13:57:07 INFO - TEST-UNEXPECTED-PASS | image/test/browser/browser_offscreen_image_in_out_of_process_iframe.js | No frameUpdate should happen - Got 0, expected 0
[task 2019-09-13T13:57:07.591Z] 13:57:07 INFO - Stack trace:
[task 2019-09-13T13:57:07.592Z] 13:57:07 INFO - chrome://mochitests/content/browser/image/test/browser/browser_offscreen_image_in_out_of_process_iframe.js:null:127
[task 2019-09-13T13:57:07.592Z] 13:57:07 INFO - TEST-INFO | expected FAIL
[task 2019-09-13T13:57:09.596Z] 13:57:09 INFO - TEST-PASS | image/test/browser/browser_offscreen_image_in_out_of_process_iframe.js | There should be frameUpdate(s) -
[task 2019-09-13T13:57:10.647Z] 13:57:10 INFO - TEST-PASS | image/test/browser/browser_offscreen_image_in_out_of_process_iframe.js | No frameUpdate should happen -
[task 2019-09-13T13:57:10.676Z] 13:57:10 INFO - Leaving test bound
[task 2019-09-13T13:57:10.684Z] 13:57:10 INFO - GECKO(8513) | JavaScript error: resource://testing-common/PromiseTestUtils.jsm, line 112: uncaught exception: Object
[task 2019-09-13T13:57:10.684Z] 13:57:10 INFO - Console message: [JavaScript Error: "uncaught exception: Object" {file: "resource://testing-common/PromiseTestUtils.jsm" line: 112}]
[task 2019-09-13T13:57:10.685Z] 13:57:10 INFO - GECKO(8513) | MEMORY STAT | vsize 2825MB | residentFast 310MB | heapAllocated 124MB
[task 2019-09-13T13:57:10.686Z] 13:57:10 INFO - TEST-OK | image/test/browser/browser_offscreen_image_in_out_of_process_iframe.js | took 5103ms

Comment 1

[Bogdan Tara[:bogdan_tara | bogdant]]

hiro, could you, please, take a look?

Comment 2

[Intermittent Failures Robot]

30 failures in 791 pushes (0.038 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 30

Platform breakdown:

• windows7-32-devedition: 2
• macosx1014-64-shippable: 1
• windows7-32: 1
• windows10-64: 1
• macosx1014-64: 1
• macosx1014-64-devedition: 1
• windows10-64-shippable: 2
• linux64-shippable: 20
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581137&startday=2019-09-13&endday=2019-09-13&tree=all

Comment 3

[Hiroyuki Ikezoe (:hiro)]

I have no idea why the test started failing from bug 1541705. I will probably disable the todo check.

Comment 4

[Hiroyuki Ikezoe (:hiro)]

I can reproduce the UNEXPECTED pass locally with a beta sim patch, but I have no idea why it makes the test in question pass.

I did flip IS_NOT_RELEASE_OR_BETA, IS_NIGHTLY_BUILD, IS_EARLY_BETA_OR_EARLIER in StaticPrefList.yaml with the beta sim patch, but nothing changed (i.e. the test still passes). Given that the test intermitenly passes (bug 1580760) on m-c, we should allow one frameUpdate observation there, I hope it will be ultimately fixed by bug 1577084.

Comment 5

[Hiroyuki Ikezoe (:hiro)]

Attachment: Bug 1581137 - Allow one frameUpdate observation for the animated image which is out of the display port for now. r?tnikkel

For the visible image we also change the expectation, we expect two or more
frameUpdate within 2000ms to differentiate from the one frameUpdate observation.

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c42f6c242776
Allow one frameUpdate observation for the animated image which is out of the display port for now. r=tnikkel

Comment 7

[Intermittent Failures Robot]

30 failures in 4637 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 30

Platform breakdown:

• windows7-32-devedition: 2
• macosx1014-64-shippable: 1
• windows7-32: 1
• windows10-64: 1
• macosx1014-64: 1
• macosx1014-64-devedition: 1
• windows10-64-shippable: 2
• windows7-32-shippable: 1
• linux64-shippable: 20

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581137&startday=2019-09-09&endday=2019-09-15&tree=all

Comment 8

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/c42f6c242776

Comment 9

[Cosmin Sabou [:CosminS]]

Verified fix in today's beta-sims: https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&resultStatus=success%2Cpending%2Crunning%2Ctestfailed%2Cbusted%2Cexception%2Cusercancel%2Crunnable&revision=6c532c43fce2a6d809c96d003e88a75372b38fbd&searchStr=mochitests%2Ctest-macosx1014-64-shippable%2Fopt-mochitest-browser-chrome-e1&selectedJob=266855468