Closed
Bug 1934357
Opened 3 months ago
Closed 3 months ago
Perma [tier 2] QA test_pdf_zoom | AssertionError('Mismatching screenshots for test_pdf_zoom_p1_75p-beta_2204.png with extremas: ((0, 10), (0, 60), (0, 60))')
Categories
(Firefox Build System :: Task Configuration, defect, P5)
Firefox Build System
Task Configuration
Tracking
(firefox135 fixed)
RESOLVED
FIXED
135 Branch
Tracking | Status | |
---|---|---|
firefox135 | --- | fixed |
People
(Reporter: intermittent-bug-filer, Assigned: gerard-majax)
References
Details
(Keywords: intermittent-failure)
Attachments
(1 file)
Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=484819277&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OcLbYs8FTOqtlP5MROn-og/runs/0/artifacts/public/logs/live_backing.log
[task 2024-11-30T06:51:47.965Z] TEST-START | test_pdf_download
[task 2024-11-30T06:51:58.792Z] Wait for consent form: timed out, maybe it is not here
[task 2024-11-30T06:52:08.861Z] Saving screenshot 'screenshot_test_pdf_download_timeout.png' to '/task_173294900971086/builds/worker/artifacts/screenshot_test_pdf_download_timeout.png'
[task 2024-11-30T06:52:08.887Z] Saving screenshot 'screenshot_test_pdf_download_timeout_parent.png' to '/task_173294900971086/builds/worker/artifacts/screenshot_test_pdf_download_timeout_parent.png'
[task 2024-11-30T06:52:08.951Z] TEST-UNEXPECTED-TIMEOUT | test_pdf_download | TimeoutException()
[task 2024-11-30T06:52:08.951Z] TEST-INFO took 20986ms
[task 2024-11-30T06:52:08.951Z] Traceback (most recent call last):
[task 2024-11-30T06:52:08.951Z] File "/task_173294900971086/fetches/basic_tests.py", line 101, in __init__
[task 2024-11-30T06:52:08.951Z] rv = getattr(self, m)(expectations)
[task 2024-11-30T06:52:08.951Z] File "/task_173294900971086/fetches/qa_tests.py", line 584, in test_pdf_download
[task 2024-11-30T06:52:08.951Z] download_button = self._wait.until(
[task 2024-11-30T06:52:08.951Z] File "/home/task_173294900971086/.local/lib/python3.10/site-packages/selenium/webdriver/support/wait.py", line 95, in until
[task 2024-11-30T06:52:08.951Z] raise TimeoutException(message, screen, stacktrace)
[task 2024-11-30T06:52:08.951Z] selenium.common.exceptions.TimeoutException: Message:
[task 2024-11-30T06:52:08.951Z] Stacktrace:
[task 2024-11-30T06:52:08.951Z] RemoteError@chrome://remote/content/shared/RemoteError.sys.mjs:8:8
[task 2024-11-30T06:52:08.951Z] WebDriverError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:193:5
[task 2024-11-30T06:52:08.951Z] NoSuchElementError@chrome://remote/content/shared/webdriver/Errors.sys.mjs:511:5
[task 2024-11-30T06:52:08.951Z] dom.find/</<@chrome://remote/content/shared/DOM.sys.mjs:136:16
[task 2024-11-30T06:52:08.951Z]
[task 2024-11-30T06:52:08.953Z] tabs_after EXCEPTION {'e590cd73-23c0-4dcd-98d3-0f60c649671b', '4a214302-eedb-4c5a-8025-578ae14d6702'}
[task 2024-11-30T06:52:08.953Z] tabs_before {'e590cd73-23c0-4dcd-98d3-0f60c649671b'}
[task 2024-11-30T06:52:08.953Z] opened 1 tabs
[task 2024-11-30T06:52:08.953Z] opened {'4a214302-eedb-4c5a-8025-578ae14d6702'} tabs
[task 2024-11-30T06:52:08.953Z] switch to 4a214302-eedb-4c5a-8025-578ae14d6702
[task 2024-11-30T06:52:08.955Z] close 4a214302-eedb-4c5a-8025-578ae14d6702
[task 2024-11-30T06:52:08.981Z] wait EC.number_of_windows_to_be(1)
[task 2024-11-30T06:52:08.985Z] TEST-START | test_pdf_navigation
[task 2024-11-30T06:52:14.896Z] assert down
[task 2024-11-30T06:52:16.745Z] assert up
[task 2024-11-30T06:52:18.608Z] assert right
[task 2024-11-30T06:52:20.508Z] assert left
[task 2024-11-30T06:52:22.378Z] assert pagedown
[task 2024-11-30T06:52:24.258Z] assert pageup
[task 2024-11-30T06:52:26.181Z] assert end
[task 2024-11-30T06:52:28.071Z] assert home
[task 2024-11-30T06:52:29.103Z] assert next twice 1 => 3
[task 2024-11-30T06:52:29.908Z] assert previous 3 => 2
[task 2024-11-30T06:52:30.502Z] reset to page for firstPage
[task 2024-11-30T06:52:30.727Z] click menu for firstPage
[task 2024-11-30T06:52:30.944Z] find button for firstPage
[task 2024-11-30T06:52:30.959Z] click button for firstPage
[task 2024-11-30T06:52:31.925Z] assert firstPage
[task 2024-11-30T06:52:32.524Z] reset to page for lastPage
[task 2024-11-30T06:52:32.747Z] click menu for lastPage
[task 2024-11-30T06:52:32.961Z] find button for lastPage
[task 2024-11-30T06:52:32.971Z] click button for lastPage
[task 2024-11-30T06:52:33.942Z] assert lastPage
[task 2024-11-30T06:52:34.554Z] reset to page for pageRotateCw
[task 2024-11-30T06:52:34.789Z] click menu for pageRotateCw
[task 2024-11-30T06:52:35.020Z] find button for pageRotateCw
[task 2024-11-30T06:52:35.032Z] click button for pageRotateCw
[task 2024-11-30T06:52:36.002Z] assert pageRotateCw
[task 2024-11-30T06:52:36.615Z] reset to page for pageRotateCcw
[task 2024-11-30T06:52:36.841Z] click menu for pageRotateCcw
[task 2024-11-30T06:52:37.057Z] find button for pageRotateCcw
[task 2024-11-30T06:52:37.067Z] click button for pageRotateCcw
[task 2024-11-30T06:52:38.080Z] assert pageRotateCcw
[task 2024-11-30T06:52:38.673Z] reset to page for documentProperties
[task 2024-11-30T06:52:38.899Z] click menu for documentProperties
[task 2024-11-30T06:52:39.113Z] find button for documentProperties
[task 2024-11-30T06:52:39.124Z] click button for documentProperties
[task 2024-11-30T06:52:40.094Z] assert documentProperties
[task 2024-11-30T06:52:45.856Z] tabs_after OK {'e590cd73-23c0-4dcd-98d3-0f60c649671b', '0efb2e44-b72c-465d-b299-2fc3900d4aab'}
[task 2024-11-30T06:52:45.857Z] TEST-OK | test_pdf_navigation | took 36872ms
[task 2024-11-30T06:52:45.857Z] tabs_before {'e590cd73-23c0-4dcd-98d3-0f60c649671b'}
[task 2024-11-30T06:52:45.857Z] opened 1 tabs
[task 2024-11-30T06:52:45.857Z] opened {'0efb2e44-b72c-465d-b299-2fc3900d4aab'} tabs
[task 2024-11-30T06:52:45.857Z] switch to 0efb2e44-b72c-465d-b299-2fc3900d4aab
[task 2024-11-30T06:52:45.858Z] close 0efb2e44-b72c-465d-b299-2fc3900d4aab
[task 2024-11-30T06:52:45.900Z] wait EC.number_of_windows_to_be(1)
[task 2024-11-30T06:52:45.904Z] TEST-START | test_pdf_zoom
[task 2024-11-30T06:52:48.227Z] assert p1_100p
[task 2024-11-30T06:52:50.133Z] assert p1_50p
[task 2024-11-30T06:52:50.722Z] Non empty differences bbox: (599, 51, 891, 604)
[task 2024-11-30T06:52:52.130Z] assert p1_75p
[task 2024-11-30T06:52:52.717Z] Non empty differences bbox: (488, 45, 976, 894)
[task 2024-11-30T06:52:52.825Z] Saving screenshot 'screenshot_test_pdf_zoom_fail.png' to '/task_173294900971086/builds/worker/artifacts/screenshot_test_pdf_zoom_fail.png'
[task 2024-11-30T06:52:52.876Z] Saving screenshot 'screenshot_test_pdf_zoom_fail_parent.png' to '/task_173294900971086/builds/worker/artifacts/screenshot_test_pdf_zoom_fail_parent.png'
[task 2024-11-30T06:52:52.925Z] TEST-UNEXPECTED-FAIL | test_pdf_zoom | AssertionError('Mismatching screenshots for test_pdf_zoom_p1_75p-beta_2204.png with extremas: ((0, 10), (0, 60), (0, 60))')
[task 2024-11-30T06:52:52.925Z] TEST-INFO took 7020ms
[task 2024-11-30T06:52:52.925Z] Traceback (most recent call last):
[task 2024-11-30T06:52:52.925Z] File "/task_173294900971086/fetches/basic_tests.py", line 101, in __init__
[task 2024-11-30T06:52:52.925Z] rv = getattr(self, m)(expectations)
[task 2024-11-30T06:52:52.925Z] File "/task_173294900971086/fetches/qa_tests.py", line 560, in test_pdf_zoom
[task 2024-11-30T06:52:52.925Z] self.assert_rendering(exp[ref], self._driver)
[task 2024-11-30T06:52:52.925Z] File "/task_173294900971086/fetches/basic_tests.py", line 312, in assert_rendering
[task 2024-11-30T06:52:52.925Z] assert (
[task 2024-11-30T06:52:52.925Z] AssertionError: Mismatching screenshots for test_pdf_zoom_p1_75p-beta_2204.png with extremas: ((0, 10), (0, 60), (0, 60))
[task 2024-11-30T06:52:52.926Z] tabs_after EXCEPTION {'e590cd73-23c0-4dcd-98d3-0f60c649671b', '22e9142a-c418-43d0-bd0f-b882947db6c8'}
[task 2024-11-30T06:52:52.927Z] tabs_before {'e590cd73-23c0-4dcd-98d3-0f60c649671b'}
[task 2024-11-30T06:52:52.927Z] opened 1 tabs
[task 2024-11-30T06:52:52.927Z] opened {'22e9142a-c418-43d0-bd0f-b882947db6c8'} tabs
[task 2024-11-30T06:52:52.927Z] switch to 22e9142a-c418-43d0-bd0f-b882947db6c8
[task 2024-11-30T06:52:52.929Z] close 22e9142a-c418-43d0-bd0f-b882947db6c8
[task 2024-11-30T06:52:52.968Z] wait EC.number_of_windows_to_be(1)
[task 2024-11-30T06:52:53.747Z] Exiting with False
[task 2024-11-30T06:52:53.747Z] SUITE-END | took 120s
[taskcluster 2024-11-30T06:52:53.777Z] Exit Code: 1
[taskcluster 2024-11-30T06:52:53.777Z] User Time: 54.013688s
[taskcluster 2024-11-30T06:52:53.777Z] Kernel Time: 14.424877s
[taskcluster 2024-11-30T06:52:53.777Z] Wall Time: 2m42.949513588s
[taskcluster 2024-11-30T06:52:53.777Z] Result: FAILED
[taskcluster 2024-11-30T06:52:53.778Z] === Task Finished ===
[taskcluster 2024-11-30T06:52:53.778Z] Task Duration: 2m42.950887474s
[taskcluster 2024-11-30T06:52:53.875Z] Uploading artifact public/build/reference_rendering.png from file /task_173294900971086/builds/worker/artifacts/reference_rendering.png with content encoding "identity", mime type "image/png" and expiry 2025-02-28T06:50:06.277Z
[taskcluster 2024-11-30T06:52:53.877Z] Uploading artifact public/build/screenshot_test_pdf_zoom_fail_parent.png from file /task_173294900971086/builds/worker/artifacts/screenshot_test_pdf_zoom_fail_parent.png with content encoding "identity", mime type "image/png" and expiry 2025-02-28T06:50:06.277Z
[taskcluster 2024-11-30T06:52:53.878Z] Uploading artifact public/build/screenshot_test_pdf_zoom_fail.png from file /task_173294900971086/builds/worker/artifacts/screenshot_test_pdf_zoom_fail.png with content encoding "identity", mime type "image/png" and expiry 2025-02-28T06:50:06.277Z
[taskcluster 2024-11-30T06:52:53.879Z] Uploading artifact public/build/screenshot_test_pdf_download_timeout.png from file /task_173294900971086/builds/worker/artifacts/screenshot_test_pdf_download_timeout.png with content encoding "identity", mime type "image/png" and expiry 2025-02-28T06:50:06.277Z
[taskcluster 2024-11-30T06:52:53.880Z] Uploading artifact public/build/differences.png from file /task_173294900971086/builds/worker/artifacts/differences.png with content encoding "identity", mime type "image/png" and expiry 2025-02-28T06:50:06.277Z
[taskcluster 2024-11-30T06:52:53.885Z] Uploading artifact public/build/screenshot_test_pdf_download_timeout_parent.png from file /task_173294900971086/builds/worker/artifacts/screenshot_test_pdf_download_timeout_parent.png with content encoding "identity", mime type "image/png" and expiry 2025-02-28T06:50:06.277Z
[taskcluster 2024-11-30T06:52:53.887Z] Uploading artifact public/build/geckodriver.log from file /task_173294900971086/builds/worker/artifacts/geckodriver.log with content encoding "gzip", mime type "text/plain" and expiry 2025-02-28T06:50:06.277Z
[taskcluster 2024-11-30T06:52:53.897Z] Uploading artifact public/build/current_rendering.png from file /task_173294900971086/builds/worker/artifacts/current_rendering.png with content encoding "identity", mime type "image/png" and expiry 2025-02-28T06:50:06.277Z
[taskcluster 2024-11-30T06:52:54.132Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-02-28T06:50:06.277Z
[taskcluster:error] exit status 1
Updated•3 months ago
|
Flags: needinfo?(lissyx+mozillians)
Assignee | ||
Updated•3 months ago
|
Assignee: nobody → lissyx+mozillians
Flags: needinfo?(lissyx+mozillians)
Assignee | ||
Comment 1•3 months ago
•
|
||
I can't see a visual difference, likely some background noise, I'll update references cf https://hg.mozilla.org/try/rev/87a71dc7769c61a20961af643a76dfd5a874764a
Assignee | ||
Comment 2•3 months ago
|
||
Assignee | ||
Comment 3•3 months ago
|
||
Comment hidden (Intermittent Failures Robot) |
Pushed by alissy@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/a9c1fd7f6e72
Update references screenshots for QA Snap test PDF Zoom on Beta r=benchatt
Comment 6•3 months ago
|
||
bugherder |
Status: NEW → RESOLVED
Closed: 3 months ago
status-firefox135:
--- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 135 Branch
Comment hidden (Intermittent Failures Robot) |
You need to log in
before you can comment on or make changes to this bug.
Description
•