Closed Bug 2016112 Opened 9 months ago Closed 9 months ago

Intermittent TVw ::: Test verification FAIL | TinderboxPrint: Per-test run of ...\set_viewport\user_contexts.py<br/>: FAILURE

Categories

(Testing :: web-platform-tests, defect, P5)

Product:
Testing
Component:
web-platform-tests
Type:
defect
Points:
1

Tracking

(firefox-esr140 unaffected, firefox147 unaffected, firefox148 unaffected, firefox149 fixed)

Status:
RESOLVED FIXED
Milestone:
149 Branch
Tracking Flags:
Tracking Status
firefox-esr140 --- unaffected
firefox147 --- unaffected
firefox148 --- unaffected
firefox149 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: Sasha)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, test-verify-fail, Whiteboard: [webdriver:m19], [wptsync upstream])

Attachments

(1 external file)

Filed by: rperta [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=548136420&repo=autoland&task=OW0Dz_EMTK6kWaQ8lMdvHg.0
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OW0Dz_EMTK6kWaQ8lMdvHg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/default/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/OW0Dz_EMTK6kWaQ8lMdvHg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2026-02-11T13:22:53.704+00:00] 13:22:53     INFO - TEST-OK | /webdriver/tests/bidi/browsing_context/set_viewport/user_contexts.py | took 8994ms
[task 2026-02-11T13:22:53.705+00:00] 13:22:53     INFO - No more tests
[task 2026-02-11T13:22:53.774+00:00] 13:22:53     INFO - Closing logging queue
[task 2026-02-11T13:22:53.775+00:00] 13:22:53     INFO - queue closed
[task 2026-02-11T13:22:53.778+00:00] 13:22:53     INFO - SUITE-END | took 103s
[task 2026-02-11T13:22:53.778+00:00] 13:22:53     INFO - Got 0 unexpected results, with 0 unexpected passes
[task 2026-02-11T13:22:53.778+00:00] 13:22:53     INFO - wptserve Stopped http server on 127.0.0.1:8002
[task 2026-02-11T13:22:53.778+00:00] 13:22:53     INFO - wptserve Stopped http server on 127.0.0.1:8000
[task 2026-02-11T13:22:53.779+00:00] 13:22:53     INFO - wptserve Stopped http server on 127.0.0.1:8003
[task 2026-02-11T13:22:53.794+00:00] 13:22:53     INFO - wptserve Stopped http server on 127.0.0.1:8443
[task 2026-02-11T13:22:53.794+00:00] 13:22:53     INFO - wptserve Stopped http server on 127.0.0.1:8001
[task 2026-02-11T13:22:53.795+00:00] 13:22:53     INFO - wptserve Stopped http server on 127.0.0.1:8444
[task 2026-02-11T13:22:53.795+00:00] 13:22:53     INFO - wptserve Stopped http server on 127.0.0.1:8445
[task 2026-02-11T13:22:53.795+00:00] 13:22:53     INFO - wptserve Stopped http server on 127.0.0.1:8446
[task 2026-02-11T13:22:53.797+00:00] 13:22:53     INFO - wptserve Stopped http server on 127.0.0.1:9000
[task 2026-02-11T13:22:53.797+00:00] 13:22:53     INFO - wptserve Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
[task 2026-02-11T13:22:54.190+00:00] 13:22:54     INFO - wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
[task 2026-02-11T13:22:54.238+00:00] 13:22:54     INFO - wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
[task 2026-02-11T13:22:54.398+00:00] 13:22:54     INFO - Closing logging queue
[task 2026-02-11T13:22:54.399+00:00] 13:22:54     INFO - queue closed
[task 2026-02-11T13:22:54.570+00:00] 13:22:54     INFO - ::: Ran 10 of expected 10 iterations.
[task 2026-02-11T13:22:54.572+00:00] 13:22:54     INFO - ## All results ##
[task 2026-02-11T13:22:54.572+00:00] 13:22:54     INFO - 
[task 2026-02-11T13:22:54.572+00:00] 13:22:54     INFO - ### /webdriver/tests/bidi/browsing_context/set_viewport/user_contexts.py ###
[task 2026-02-11T13:22:54.573+00:00] 13:22:54     INFO - |                                  Subtest                                   | Results | Messages |
[task 2026-02-11T13:22:54.573+00:00] 13:22:54     INFO - |----------------------------------------------------------------------------|---------|----------|
[task 2026-02-11T13:22:54.573+00:00] 13:22:54     INFO - |                                                                            | OK      |          |
[task 2026-02-11T13:22:54.574+00:00] 13:22:54     INFO - | `test_set_to_user_context`                                                 | PASS    |          |
[task 2026-02-11T13:22:54.574+00:00] 13:22:54     INFO - | `test_set_to_user_context_window_open`                                     | PASS    |          |
[task 2026-02-11T13:22:54.575+00:00] 13:22:54     INFO - | `test_set_to_default_user_context`                                         | PASS    |          |
[task 2026-02-11T13:22:54.576+00:00] 13:22:54     INFO - | `test_set_to_multiple_user_contexts`                                       | PASS    |          |
[task 2026-02-11T13:22:54.576+00:00] 13:22:54     INFO - | `test_undefined_viewport`                                                  | PASS    |          |
[task 2026-02-11T13:22:54.576+00:00] 13:22:54     INFO - | `test_reset_to_default`                                                    | PASS    |          |
[task 2026-02-11T13:22:54.577+00:00] 13:22:54     INFO - | `test_set_viewport_and_device_pixel_ratio`                                 | PASS    |          |
[task 2026-02-11T13:22:54.577+00:00] 13:22:54     INFO - | `test_set_to_user_context_and_then_to_context`                             | PASS    |          |
[task 2026-02-11T13:22:54.577+00:00] 13:22:54     INFO - | `test_set_viewport_to_user_context_and_then_device_pixel_ratio_to_context` | PASS    |          |
[task 2026-02-11T13:22:54.578+00:00] 13:22:54     INFO - 
[task 2026-02-11T13:22:54.578+00:00] 13:22:54     INFO - ## Slow tests ##
[task 2026-02-11T13:22:54.578+00:00] 13:22:54     INFO - 
[task 2026-02-11T13:22:54.578+00:00] 13:22:54     INFO - |                                  Test                                  | Result | Longest duration (ms) | Timeout (ms) |
[task 2026-02-11T13:22:54.579+00:00] 13:22:54     INFO - |------------------------------------------------------------------------|--------|-----------------------|--------------|
[task 2026-02-11T13:22:54.579+00:00] 13:22:54     INFO - | `/webdriver/tests/bidi/browsing_context/set_viewport/user_contexts.py` | `OK`   | `20535`               | `25000`      |
[task 2026-02-11T13:22:54.580+00:00] 13:22:54     INFO - 
[task 2026-02-11T13:22:54.580+00:00] 13:22:54     INFO - ::: Running tests in a loop 10 times : FAIL
[task 2026-02-11T13:22:54.580+00:00] 13:22:54     INFO - :::
[task 2026-02-11T13:22:54.581+00:00] 13:22:54    ERROR - ::: Test verification FAIL
[task 2026-02-11T13:22:54.581+00:00] 13:22:54     INFO - :::
[task 2026-02-11T13:22:54.964+00:00] 13:22:54     INFO - Return code: 1
[task 2026-02-11T13:22:54.978+00:00] 13:22:54  WARNING - setting return code to 2
[task 2026-02-11T13:22:54.978+00:00] 13:22:54    ERROR - TinderboxPrint: Per-test run of ...\set_viewport\user_contexts.py<br/>: FAILURE
[task 2026-02-11T13:22:54.978+00:00] 13:22:54     INFO - Running post-action listener: _package_coverage_data
[task 2026-02-11T13:22:54.978+00:00] 13:22:54     INFO - Running post-action listener: _resource_record_post_action
[task 2026-02-11T13:22:54.978+00:00] 13:22:54     INFO - Running post-action listener: process_java_coverage_data
[task 2026-02-11T13:22:54.978+00:00] 13:22:54     INFO - Running post-action listener: stop_device
[task 2026-02-11T13:22:54.978+00:00] 13:22:54     INFO - [mozharness: 2026-02-11 13:22:54.978528Z] Finished run-tests step (success)
[task 2026-02-11T13:22:54.979+00:00] 13:22:54     INFO - Running post-run listener: _resource_record_post_run
[task 2026-02-11T13:22:55.170+00:00] 13:22:55     INFO - Total resource usage - Wall time: 151s; CPU: 23%; Read bytes: 334640640; Write bytes: 533445120; Read time: 4; Write time: 2
[task 2026-02-11T13:22:55.170+00:00] 13:22:55     INFO - TinderboxPrint: CPU usage<br/>23.1%
[task 2026-02-11T13:22:55.170+00:00] 13:22:55     INFO - TinderboxPrint: I/O read bytes / time<br/>334,640,640 / 4
[task 2026-02-11T13:22:55.170+00:00] 13:22:55     INFO - TinderboxPrint: I/O write bytes / time<br/>533,445,120 / 2
[task 2026-02-11T13:22:55.170+00:00] 13:22:55     INFO - TinderboxPrint: CPU idle<br/>923.9 (76.7%)
[task 2026-02-11T13:22:55.170+00:00] 13:22:55     INFO - TinderboxPrint: CPU system<br/>112.8 (9.4%)
[task 2026-02-11T13:22:55.170+00:00] 13:22:55     INFO - TinderboxPrint: CPU user<br/>163.8 (13.6%)
[task 2026-02-11T13:22:55.176+00:00] 13:22:55     INFO - pull - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2026-02-11T13:22:55.176+00:00] 13:22:55     INFO - start-emulator - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2026-02-11T13:22:55.176+00:00] 13:22:55     INFO - verify-device - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2026-02-11T13:22:55.177+00:00] 13:22:55     INFO - install - Wall time: 3s; CPU: 14%; Read bytes: 6943232; Write bytes: 22478848; Read time: 0; Write time: 0
[task 2026-02-11T13:22:55.188+00:00] 13:22:55     INFO - run-tests - Wall time: 148s; CPU: 23%; Read bytes: 327697408; Write bytes: 510966272; Read time: 4; Write time: 2
[task 2026-02-11T13:22:55.780+00:00] 13:22:55  WARNING - returning nonzero exit status 2
[taskcluster 2026-02-11T13:22:56.378Z]                        Exit Code: 2
[taskcluster 2026-02-11T13:22:56.378Z]                        User Time: 0s
[taskcluster 2026-02-11T13:22:56.378Z]                      Kernel Time: 15.625ms
[taskcluster 2026-02-11T13:22:56.378Z]                        Wall Time: 5m36.7553734s
[taskcluster 2026-02-11T13:22:56.378Z]  Average Available System Memory: 12.60 GiB
[taskcluster 2026-02-11T13:22:56.378Z]       Average System Memory Used: 3.40 GiB
[taskcluster 2026-02-11T13:22:56.378Z]          Peak System Memory Used: 4.35 GiB
[taskcluster 2026-02-11T13:22:56.378Z]              Total System Memory: 16.00 GiB
[taskcluster 2026-02-11T13:22:56.378Z]                           Result: FAILED
[taskcluster 2026-02-11T13:22:56.379Z] === Task Finished ===
[taskcluster 2026-02-11T13:22:56.379Z] Task Duration: 5m36.7569357s
[taskcluster 2026-02-11T13:22:57.224Z] [mounts] Preserving cache: Moving "D:\\task_177081307492644\\.task-cache\\pip" to "D:\\caches\\U4rxpY_ERnyFEQ_OcpwyyQ"
[taskcluster 2026-02-11T13:22:57.226Z] [mounts] Preserving cache: Moving "D:\\task_177081307492644\\.task-cache\\uv" to "D:\\caches\\BKENSCDgQca9ZpXNbkzC7A"
[taskcluster:error] exit status 2
Keywords: regression
Regressed by: 2005558

:Sasha, since you are the author of the regressor, bug 2005558, could you take a look?

For more information, please visit BugBot documentation.

Flags: needinfo?(aborovova)

Set release status flags based on info from the regressing bug 2005558

status-firefox147: --- → unaffected
status-firefox148: --- → unaffected
status-firefox149: --- → affected
status-firefox-esr140: --- → unaffected
Assignee: nobody → aborovova
Status: NEW → ASSIGNED

So the test run failed for /webdriver/tests/bidi/browsing_context/set_viewport/user_contexts.py just because it got slower, which is understandable since I extended the test in the scope of bug 2005558. Moving the extended test to the separate file seems to resolve the failure.

Flags: needinfo?(aborovova)
Points: --- → 1
Whiteboard: [webdriver:m19]
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/57772 for changes under testing/web-platform/tests
Whiteboard: [webdriver:m19] → [webdriver:m19], [wptsync upstream]
Pushed by imoraru@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/693ebdb6301d https://hg.mozilla.org/mozilla-central/rev/de83a2925ba9 Move "test_set_to_user_context_window_open" test to a separate file. r=jdescottes

https://hg.mozilla.org/mozilla-central/rev/de83a2925ba9

Status: ASSIGNED → RESOLVED
Closed: 9 months ago
status-firefox149: affected → fixed
Resolution: --- → FIXED
Target Milestone: --- → 149 Branch
Upstream PR merged by moz-wptsync-bot
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: