1922432 - Perma [Tier 2] Snap_QA test_pdf_navigation | AssertionError('Mismatching screenshots for test_pdf_navigation_base-nightly.png with extremas: ((0, 173), (0, 173), (0, 174))')

Status: RESOLVED FIXED

(Firefox Build System :: Third Party Packaging, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: smolnar [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=476622073&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VwIOipwPTtSKqKloLn0IzA/runs/0/artifacts/public/logs/live_backing.log

---

TEST-START | test_pdf_navigation
[task 2024-10-03T00:53:05.791Z] Non empty differences bbox: (9, 0, 113, 28)
[task 2024-10-03T00:53:05.896Z] Saving screenshot 'screenshot_test_pdf_navigation_fail.png' to '/task_172791643698094/builds/worker/artifacts/screenshot_test_pdf_navigation_fail.png'
[task 2024-10-03T00:53:06.016Z] Saving screenshot 'screenshot_test_pdf_navigation_fail_parent.png' to '/task_172791643698094/builds/worker/artifacts/screenshot_test_pdf_navigation_fail_parent.png'
[task 2024-10-03T00:53:06.176Z] TEST-UNEXPECTED-FAIL | test_pdf_navigation | AssertionError('Mismatching screenshots for test_pdf_navigation_base-nightly.png with extremas: ((0, 173), (0, 173), (0, 174))')
[task 2024-10-03T00:53:06.176Z] TEST-INFO took 8765ms
[task 2024-10-03T00:53:06.176Z] Traceback (most recent call last):
[task 2024-10-03T00:53:06.176Z]   File "/task_172791643698094/fetches/basic_tests.py", line 97, in __init__
[task 2024-10-03T00:53:06.176Z]     rv = getattr(self, m)(expectations)
[task 2024-10-03T00:53:06.176Z]   File "/task_172791643698094/fetches/qa_tests.py", line 312, in test_pdf_navigation
[task 2024-10-03T00:53:06.176Z]     self.assert_rendering(exp["base"], self._driver)
[task 2024-10-03T00:53:06.176Z]   File "/task_172791643698094/fetches/basic_tests.py", line 303, in assert_rendering
[task 2024-10-03T00:53:06.176Z]     assert (
[task 2024-10-03T00:53:06.176Z] AssertionError: Mismatching screenshots for test_pdf_navigation_base-nightly.png with extremas: ((0, 173), (0, 173), (0, 174))
[task 2024-10-03T00:53:06.179Z] tabs_after EXCEPTION {'d1e07fe4-e796-4992-a0ac-0e29ddd1d5ba', '77cacebc-2582-45e1-a73d-c9bd5cc74daa'}
[task 2024-10-03T00:53:06.180Z] tabs_before {'d1e07fe4-e796-4992-a0ac-0e29ddd1d5ba'}
[task 2024-10-03T00:53:06.180Z] opened 1 tabs
[task 2024-10-03T00:53:06.180Z] opened {'77cacebc-2582-45e1-a73d-c9bd5cc74daa'} tabs
[task 2024-10-03T00:53:06.180Z] switch to 77cacebc-2582-45e1-a73d-c9bd5cc74daa
[task 2024-10-03T00:53:06.183Z] close 77cacebc-2582-45e1-a73d-c9bd5cc74daa
[task 2024-10-03T00:53:06.266Z] wait EC.number_of_windows_to_be(1)
[task 2024-10-03T00:53:06.286Z] TEST-START | test_pdf_zoom
[task 2024-10-03T00:53:13.979Z] assert p1_100p
[task 2024-10-03T00:53:14.638Z] Non empty differences bbox: (9, 0, 113, 28)
[task 2024-10-03T00:53:14.799Z] Saving screenshot 'screenshot_test_pdf_zoom_fail.png' to '/task_172791643698094/builds/worker/artifacts/screenshot_test_pdf_zoom_fail.png'
[task 2024-10-03T00:53:14.929Z] Saving screenshot 'screenshot_test_pdf_zoom_fail_parent.png' to '/task_172791643698094/builds/worker/artifacts/screenshot_test_pdf_zoom_fail_parent.png'
[task 2024-10-03T00:53:15.093Z] TEST-UNEXPECTED-FAIL | test_pdf_zoom | AssertionError('Mismatching screenshots for test_pdf_zoom_p1_100p-nightly.png with extremas: ((0, 173), (0, 173), (0, 174))')
[task 2024-10-03T00:53:15.093Z] TEST-INFO took 8808ms
[task 2024-10-03T00:53:15.093Z] Traceback (most recent call last):
[task 2024-10-03T00:53:15.093Z]   File "/task_172791643698094/fetches/basic_tests.py", line 97, in __init__
[task 2024-10-03T00:53:15.093Z]     rv = getattr(self, m)(expectations)
[task 2024-10-03T00:53:15.093Z]   File "/task_172791643698094/fetches/qa_tests.py", line 517, in test_pdf_zoom
[task 2024-10-03T00:53:15.093Z]     self.assert_rendering(exp[ref], self._driver)
[task 2024-10-03T00:53:15.093Z]   File "/task_172791643698094/fetches/basic_tests.py", line 303, in assert_rendering
[task 2024-10-03T00:53:15.093Z]     assert (
[task 2024-10-03T00:53:15.093Z] AssertionError: Mismatching screenshots for test_pdf_zoom_p1_100p-nightly.png with extremas: ((0, 173), (0, 173), (0, 174))
[task 2024-10-03T00:53:15.327Z] tabs_after EXCEPTION {'d1e07fe4-e796-4992-a0ac-0e29ddd1d5ba', '741483c1-e09b-4240-885c-a05dfdbdc307'}
[task 2024-10-03T00:53:15.328Z] tabs_before {'d1e07fe4-e796-4992-a0ac-0e29ddd1d5ba'}
[task 2024-10-03T00:53:15.328Z] opened 1 tabs
[task 2024-10-03T00:53:15.328Z] opened {'741483c1-e09b-4240-885c-a05dfdbdc307'} tabs
[task 2024-10-03T00:53:15.328Z] switch to 741483c1-e09b-4240-885c-a05dfdbdc307
[task 2024-10-03T00:53:15.334Z] close 741483c1-e09b-4240-885c-a05dfdbdc307
[task 2024-10-03T00:53:15.421Z] wait EC.number_of_windows_to_be(1)
[task 2024-10-03T00:53:17.236Z] Exiting with False
[task 2024-10-03T00:53:17.236Z] SUITE-END | took 164s

Comment 1

[:gerard-majax]

Does not make sense, try was green ...

Comment 2

[:gerard-majax]

Attachment: Bug 1922432 - Update Snap QA screenshots for Beta r?benchatt!

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ac5d9763efc2
Update Snap QA screenshots for Beta r=benchatt

Comment 4

[tszentpeteri]

https://hg.mozilla.org/mozilla-central/rev/ac5d9763efc2

Comment 6

[tszentpeteri]

Hi, the bug is still present here
Could you take another look?

Comment 7

[:gerard-majax]

This is failing on nightly, this bug was about beta

Comment 8

[Intermittent Failures Robot]

15 failures in 3574 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 15

Platform and build breakdown:

• linux64-snap-amd64-nightly: 6
  • debug: 5
  • opt: 1
• linux64-snap-beta: 9
  • debug: 6
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1922432&startday=2024-09-30&endday=2024-10-06&tree=all