1796833 - Perma TEST-UNEXPECTED-PASS | dom/media/test/reftest/color_quads/720p.png.bt709.bt709.pc.yuv420p.vp9.webm == dom/media/test/reftest/color_quads/720p.png.bt709.bt709.pc.yuv420p.av1.webm | image comparison, max difference: 16, number of differing pixels: 187

Status: RESOLVED FIXED

(Core :: Audio/Video: Playback, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=393977428&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ewgscH5XQbCj_fNv9yb94w/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ewgscH5XQbCj_fNv9yb94w/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2022-10-21T19:18:27.454Z] 19:18:27     INFO - REFTEST TEST-START | dom/media/test/reftest/color_quads/720p.png.bt709.bt709.pc.yuv420p.vp9.webm == dom/media/test/reftest/color_quads/720p.png.bt709.bt709.pc.yuv420p.av1.webm
[task 2022-10-21T19:18:27.454Z] 19:18:27     INFO - REFTEST TEST-LOAD | file:///opt/worker/tasks/task_1666379671/build/tests/reftest/tests/dom/media/test/reftest/reftest_video.html?src=color_quads/720p.png.bt709.bt709.pc.yuv420p.vp9.webm | 7 / 29 (24%)
[task 2022-10-21T19:18:27.584Z] 19:18:27     INFO - REFTEST TEST-LOAD | file:///opt/worker/tasks/task_1666379671/build/tests/reftest/tests/dom/media/test/reftest/reftest_video.html?src=color_quads/720p.png.bt709.bt709.pc.yuv420p.av1.webm | 7 / 29 (24%)
[task 2022-10-21T19:18:27.701Z] 19:18:27     INFO - REFTEST INFO | REFTEST fuzzy test (36, 187329) <= (16, 1874) <= (49, 187407)
[task 2022-10-21T19:18:27.809Z] 19:18:27     INFO - REFTEST TEST-UNEXPECTED-PASS | dom/media/test/reftest/color_quads/720p.png.bt709.bt709.pc.yuv420p.vp9.webm == dom/media/test/reftest/color_quads/720p.png.bt709.bt709.pc.yuv420p.av1.webm | image comparison, max difference: 16, number of differing pixels: 1874
[task 2022-10-21T19:18:27.810Z] 19:18:27     INFO - REFTEST   IMAGE 1 (TEST): data:image/png;base64,
[task 2022-10-21T19:18:27.810Z] 19:18:27     INFO - REFTEST   IMAGE 2 (REFERENCE): data:image/png;base64,
[task 2022-10-21T19:18:27.810Z] 19:18:27     INFO - REFTEST TEST-END | dom/media/test/reftest/color_quads/720p.png.bt709.bt709.pc.yuv420p.vp9.webm == dom/media/test/reftest/color_quads/720p.png.bt709.bt709.pc.yuv420p.av1.webm

Comment 1

[Intermittent Failures Robot]

12 failures in 2793 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 10
• try: 2

Platform and build breakdown:

• macosx1100-64-shippable-qr: 12
  • opt: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1796833&startday=2022-10-17&endday=2022-10-23&tree=all

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 1796833 - set a color_quads reftest as passing on macOS with ARM. r=jrmuizel

Comment 3

[Intermittent Failures Robot]

26 failures in 3743 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 17
• try: 9

Platform and build breakdown:

• macosx1100-64-shippable-qr: 26
  • opt: 26

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1796833&startday=2022-10-24&endday=2022-10-30&tree=all

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3e649f3ad4ba
set a color_quads reftest as passing on macOS with ARM. r=jrmuizel

Comment 5

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/3e649f3ad4ba

Comment 6

[Intermittent Failures Robot]

13 failures in 3626 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 4
• mozilla-central: 9

Platform and build breakdown:

• macosx1100-64-shippable-qr: 13
  • opt: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1796833&startday=2022-10-31&endday=2022-11-06&tree=all