1581804 - Intermittent Tier 2 image-element/element-paint-native-widget.html == image-element/element-paint-native-widget-ref.html | image comparison, max difference: x, number of differing pixels: y

Status: RESOLVED FIXED

(Core :: Layout: Images, Video, and HTML Frames, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=267021865&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/P4uw2RA0Qxeup6fgh-WBzQ/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/P4uw2RA0Qxeup6fgh-WBzQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2019-09-17T11:17:12.658Z] 11:17:12 INFO - REFTEST TEST-START | http://10.7.205.212:8854/tests/layout/reftests/image-element/element-paint-native-widget.html == http://10.7.205.212:8854/tests/layout/reftests/image-element/element-paint-native-widget-ref.html
[task 2019-09-17T11:17:12.658Z] 11:17:12 INFO - REFTEST TEST-LOAD | http://10.7.205.212:8854/tests/layout/reftests/image-element/element-paint-native-widget.html | 1701 / 1954 (87%)
[task 2019-09-17T11:17:12.658Z] 11:17:12 INFO - REFTEST TEST-LOAD | http://10.7.205.212:8854/tests/layout/reftests/image-element/element-paint-native-widget-ref.html | 1701 / 1954 (87%)
[task 2019-09-17T11:17:12.658Z] 11:17:12 INFO - REFTEST INFO | REFTEST fuzzy test (7, 23) <= (7, 1319) <= (7, 800)
[task 2019-09-17T11:17:12.658Z] 11:17:12 INFO - REFTEST TEST-UNEXPECTED-FAIL | http://10.7.205.212:8854/tests/layout/reftests/image-element/element-paint-native-widget.html == http://10.7.205.212:8854/tests/layout/reftests/image-element/element-paint-native-widget-ref.html | image comparison, max difference: 7, number of differing pixels: 1319
[task 2019-09-17T11:17:12.861Z] 11:17:12 INFO - REFTEST IMAGE 1 (TEST): data:image/png;base64,iVBORw0KG....
[task 2019-09-17T11:17:12.951Z] 11:17:12 INFO - REFTEST IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAyAAAAPoC...
[task 2019-09-17T11:17:12.951Z] 11:17:12 INFO - REFTEST TEST-END | http://10.7.205.212:8854/tests/layout/reftests/image-element/element-paint-native-widget.html == http://10.7.205.212:8854/tests/layout/reftests/image-element/element-paint-native-widget-ref.html

Comment 1

[Bogdan Tara[:bogdan_tara | bogdant]]

This seems to have started with the changes from bug 1570081.

nical, could you, please, take a look?

Comment 2

[Nicolas Silva [:nical]]

Attachment: Bug 1581804 - Adjust webrender+geckoview reftest thresholds after blob recoordination changes. r=jnicol

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/54b59550e73a
Adjust webrender+geckoview reftest thresholds after blob recoordination changes. r=jnicol

Comment 4

[Raul Gurzau (:RaulG)]

Backed out changeset 54b59550e73a (bug 1581804) for failures at /reftests/svg/reftest.list on a CLOSED TREE.

Backout link: https://hg.mozilla.org/integration/autoland/rev/fa6a1b9dde4fc3b806c5be091c67aa8ee766efd0

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&resultStatus=testfailed%2Cbusted%2Cexception&revision=404cd5ce80545eb50cc1a65c28852a4069d83ba3&selectedJob=267055490

Log link: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=267055490&repo=autoland&lineNumber=1446

Log snippet:
[task 2019-09-17T14:33:05.955Z] 14:33:05 INFO - 1568730785952 Marionette DEBUG 1 <- [1,3,null,{"value":null}]
[task 2019-09-17T14:33:06.012Z] 14:33:06 INFO - 1568730786001 Marionette DEBUG Closed connection 1
[task 2019-09-17T14:33:06.012Z] 14:33:06 INFO - ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost
[task 2019-09-17T14:33:06.416Z] 14:33:06 INFO - REFTEST INFO | Reading manifest file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/reftest.list
[task 2019-09-17T14:33:06.433Z] 14:33:06 INFO - REFTEST INFO | Dumping JSON representation of sandbox
[task 2019-09-17T14:33:06.433Z] 14:33:06 INFO - REFTEST INFO | {"isDebugBuild":false,"xulRuntime":{"widgetToolkit":"gtk","OS":"Linux","XPCOMABI":"x86_64-gcc3"},"smallScreen":false,"d2d":false,"dwrite":false,"gpuProcess":true,"azureCairo":false,"azureSkia":true,"skiaContent":true,"azureSkiaGL":false,"contentSameGfxBackendAsCanvas":true,"remoteCanvas":false,"layersGPUAccelerated":true,"d3d11":false,"d3d9":false,"layersOpenGL":true,"webrender":false,"layersOMTC":true,"advancedLayers":false,"layerChecksEnabled":true,"retainedDisplayList":true,"usesOverlayScrollbars":false,"Android":false,"cocoaWidget":false,"gtkWidget":true,"qtWidget":false,"winWidget":false,"is64Bit":true,"geckoview":false,"transparentScrollbars":true,"AddressSanitizer":true,"webrtc":true,"retainedDisplayLists":true,"compareRetainedDisplayLists":false,"skiaPdf":false,"release_or_beta":false,"http":{"userAgent":"Mozilla/5.0 (X11; Linux x86_64; rv:71.0) Gecko/20100101 Firefox/71.0","appName":"Mozilla","appVersion":"5.0","platform":"X11","oscpu":"Linux x86_64","misc":"rv:71.0"},"haveTestPlugin":true,"windowsDefaultTheme":false,"nativeThemePref":true,"gpuProcessForceEnabled":false,"prefs":{},"browserIsRemote":true,"asyncPan":true,"usesRepeatResampling":false,"verify":false,"fission":false,"serviceWorkerE10s":false}
[task 2019-09-17T14:33:11.150Z] 14:33:11 INFO - REFTEST INFO | Skipping included manifest at file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/reftest.list line 287 due to matching skip condition
[task 2019-09-17T14:33:11.151Z] 14:33:11 INFO - REFTEST INFO | Skipping included manifest at file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/reftest.list line 290 due to matching skip condition
[task 2019-09-17T14:33:11.152Z] 14:33:11 INFO - REFTEST INFO | Skipping included manifest at file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/reftest.list line 293 due to matching skip condition
[task 2019-09-17T14:33:11.853Z] 14:33:11 INFO - REFTEST INFO | Skipping included manifest at file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/reftest.list line 312 due to matching skip condition
[task 2019-09-17T14:33:12.581Z] 14:33:12 ERROR - REFTEST ERROR | EXCEPTION: Error in manifest file file:///builds/worker/workspace/build/tests/reftest/tests/layout/reftests/svg/reftest.list line 383: unexpected item fuzzy-if(geckoview&&webrender,
[task 2019-09-17T14:49:52.606Z] 14:49:52 INFO - Automation Error: mozprocess timed out after 1000 seconds running ['/builds/worker/workspace/build/venv/bin/python', '-u', '/builds/worker/workspace/build/tests/reftest/runreftest.py', '--total-chunks', '8', '--this-chunk', '1', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--appname=/builds/worker/workspace/build/application/firefox/firefox', '--utility-path=tests/bin', '--extra-profile-file=tests/bin/plugins', u'--symbols-path=https://queue.taskcluster.net/v1/task/dh4vbZCZRAaOud2vq1pvJQ/artifacts/public/build/target.crashreporter-symbols.zip', '--log-raw=/builds/worker/workspace/build/blobber_upload_dir/reftest_raw.log', '--log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/reftest_errorsummary.log', '--cleanup-crashes', '--marionette-startup-timeout=180', '--sandbox-read-whitelist=/builds/worker/workspace/build', '--log-raw=-', '--suite=reftest', '--setpref=layers.acceleration.force-enabled=true', '--', 'tests/reftest/tests/layout/reftests/reftest.list']
[task 2019-09-17T14:49:52.651Z] 14:49:52 ERROR - timed out after 1000 seconds of no output
[task 2019-09-17T14:49:52.651Z] 14:49:52 ERROR - Return code: -15
[task 2019-09-17T14:49:52.659Z] 14:49:52 ERROR - No checks run.
[task 2019-09-17T14:49:52.659Z] 14:49:52 ERROR - No suite end message was emitted by this harness.
[task 2019-09-17T14:49:52.660Z] 14:49:52 INFO - TinderboxPrint: reftest-reftest<br/><em class="testfail">T-FAIL</em>
[task 2019-09-17T14:49:52.660Z] 14:49:52 ERROR - # TBPL FAILURE #
[task 2019-09-17T14:49:52.660Z] 14:49:52 WARNING - setting return code to 2
[task 2019-09-17T14:49:52.660Z] 14:49:52 ERROR - The reftest suite: reftest ran with return status: FAILURE
[task 2019-09-17T14:49:52.660Z] 14:49:52 INFO - Running post-action listener: _package_coverage_data
[task 2019-09-17T14:49:52.661Z] 14:49:52 INFO - Running post-action listener: _resource_record_post_action
[task 2019-09-17T14:49:52.662Z] 14:49:52 INFO - Running post-action listener: process_java_coverage_data
[task 2019-09-17T14:49:52.662Z] 14:49:52 INFO - [mozharness: 2019-09-17 14:49:52.661174Z] Finished run-tests step (success)
[task 2019-09-17T14:49:52.662Z] 14:49:52 INFO - Running post-run listener: _resource_record_post_run

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/6384b9990399
Adjust webrender+geckoview reftest thresholds after blob recoordination changes. r=jnicol

Comment 6

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/6384b9990399

Comment 7

[Intermittent Failures Robot]

5 failures in 4350 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-inbound: 1
• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16-qr: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1581804&startday=2019-09-16&endday=2019-09-22&tree=all