Closed Bug 1791976 Opened 2 years ago Closed 2 years ago

Intermittent TV TEST-UNEXPECTED-PASS | layout/generic/crashtests/1644819.html | single tracking bug

Categories

(Core :: Layout, defect, P5)

Product:
Core
Component:
Layout
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE
Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox105 --- unaffected
firefox106 --- unaffected
firefox107 --- affected

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=391134166&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/atDIxyV0QXmsDA3J6A7u9g/runs/1/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/atDIxyV0QXmsDA3J6A7u9g/runs/1/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2022-09-22T08:24:29.478Z] 08:24:29     INFO -  REFTEST SUITE-START | Running 1 tests
[task 2022-09-22T08:24:29.478Z] 08:24:29     INFO -  REFTEST TEST-START | layout/generic/crashtests/1644819.html
[task 2022-09-22T08:24:29.478Z] 08:24:29     INFO -  REFTEST INFO | SET PREFERENCE pref(layout.accessiblecaret.enabled,true)
[task 2022-09-22T08:24:29.478Z] 08:24:29     INFO -  REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/layout/generic/crashtests/1644819.html | 0 / 1 (0%)
[task 2022-09-22T08:24:39.544Z] 08:24:39     INFO -  REFTEST TEST-PASS | layout/generic/crashtests/1644819.html | (LOAD ONLY)
[task 2022-09-22T08:24:39.545Z] 08:24:39     INFO -  REFTEST TEST-END | layout/generic/crashtests/1644819.html
[task 2022-09-22T08:24:39.545Z] 08:24:39  WARNING -  REFTEST TEST-UNEXPECTED-PASS | layout/generic/crashtests/1644819.html | assertion count 8 is less than expected 11 to 13 assertions
[task 2022-09-22T08:24:39.545Z] 08:24:39     INFO -  REFTEST INFO | RESTORE PREFERENCE pref(layout.accessiblecaret.enabled,false)
[task 2022-09-22T08:24:39.545Z] 08:24:39     INFO -  REFTEST INFO | Result summary:
[task 2022-09-22T08:24:39.545Z] 08:24:39     INFO -  REFTEST INFO | Successful: 1 (0 pass, 1 load only)
[task 2022-09-22T08:24:39.545Z] 08:24:39  WARNING -  REFTEST INFO | Unexpected: 1 (0 unexpected fail, 0 unexpected pass, 0 unexpected asserts, 0 failed load, 0 exception)
[task 2022-09-22T08:24:39.545Z] 08:24:39  WARNING -  One or more unittests failed.
[task 2022-09-22T08:24:39.546Z] 08:24:39     INFO -  REFTEST INFO | Known problems: 0 (0 known fail, 0 known asserts, 0 random, 0 skipped, 0 slow)
[task 2022-09-22T08:24:39.546Z] 08:24:39     INFO -  REFTEST SUITE-END | Shutdown
[task 2022-09-22T08:24:39.546Z] 08:24:39     INFO -  REFTEST INFO | Slowest test took 768ms (http://10.0.2.2:8854/tests/layout/generic/crashtests/1644819.html)
[task 2022-09-22T08:24:39.546Z] 08:24:39     INFO -  REFTEST INFO | Total canvas count = 0
[task 2022-09-22T08:24:59.681Z] 08:24:59     INFO -  REFTEST INFO | wait for org.mozilla.geckoview.test_runner complete; top activity=com.android.launcher3
[task 2022-09-22T08:24:59.681Z] 08:24:59     INFO -  REFTEST INFO | remotereftest.py | Application ran for: 0:00:34.765698
[task 2022-09-22T08:25:00.105Z] 08:25:00     INFO -  leakcheck | refcount logging is off, so leaks can't be detected!

:masayuki, since you are the author of the regressor, bug 1789967, could you take a look?

For more information, please visit auto_nag documentation.

Flags: needinfo?(masayuki)

Set release status flags based on info from the regressing bug 1789967

status-firefox105: --- → unaffected
status-firefox106: --- → unaffected
status-firefox107: --- → affected
status-firefox-esr102: --- → unaffected

Ah, this perhaps detect my wrong understanding how to emulate the traditional behavior in the existing tests. I'll post a patch to update them.

Assignee: nobody → masayuki
Status: NEW → ASSIGNED
Flags: needinfo?(masayuki)

Oh, but the change has already been backed out by the following patch because it's required to suppress the temporary failure due to splitting the patches. Therefore, it's not a regression caused by the test change. It could be reproducible without the patches for bug 1789967.

Assignee: masayuki → nobody
Status: ASSIGNED → NEW
Priority: P2 → P5

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.