Closed Bug 1574173 Opened 5 years ago Closed 5 years ago

Intermittent TV TinderboxPrint: Per-test run of ...\appearance-textfield-001.html<br/>: FAILURE

Categories

(Core :: CSS Parsing and Computation, defect, P5)

Product:
Core
Component:
CSS Parsing and Computation
Type:
defect

Tracking

()

Status:
RESOLVED INVALID

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure, regression)

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=261764505&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/UISO_VQ9Sw6t2L9HReFutA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/UISO_VQ9Sw6t2L9HReFutA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2019-08-15T11:53:33.281Z] 11:53:33 INFO - ## Unstable results ##
[task 2019-08-15T11:53:33.281Z] 11:53:33 INFO -
[task 2019-08-15T11:53:33.281Z] 11:53:33 INFO - | Test | Subtest | Results | Messages |
[task 2019-08-15T11:53:33.281Z] 11:53:33 INFO - |---------------------------------------------|---------|--------------------------|----------|
[task 2019-08-15T11:53:33.281Z] 11:53:33 INFO - | /css/css-ui/appearance-textfield-001.html | | FAIL: 3/5, PASS: 2/5 | |
[task 2019-08-15T11:53:33.281Z] 11:53:33 INFO -
[task 2019-08-15T11:53:33.281Z] 11:53:33 INFO - ::: Running tests in a loop 10 times : PASS
[task 2019-08-15T11:53:33.281Z] 11:53:33 INFO - ::: Running tests in a loop with restarts 5 times : PASS
[task 2019-08-15T11:53:33.281Z] 11:53:33 INFO - ::: Running tests in a loop 10 times with flags chaos_mode_flags=3 : PASS
[task 2019-08-15T11:53:33.282Z] 11:53:33 INFO - ::: Running tests in a loop with restarts 5 times with flags chaos_mode_flags=3 : FAIL
[task 2019-08-15T11:53:33.282Z] 11:53:33 INFO - :::
[task 2019-08-15T11:53:33.282Z] 11:53:33 ERROR - ::: Test verification FAIL
[task 2019-08-15T11:53:33.282Z] 11:53:33 INFO - :::
[task 2019-08-15T11:53:33.452Z] 11:53:33 ERROR - Return code: 1
[task 2019-08-15T11:53:33.453Z] 11:53:33 ERROR - # TBPL FAILURE #
[task 2019-08-15T11:53:33.453Z] 11:53:33 WARNING - setting return code to 2
[task 2019-08-15T11:53:33.453Z] 11:53:33 ERROR - TinderboxPrint: Per-test run of ...\appearance-textfield-001.html<br/>: FAILURE
[task 2019-08-15T11:53:33.459Z] 11:53:33 INFO - Running command: ['Z:\task_1565867685\build\venv\Scripts\python', '-u', 'Z:\task_1565867685\build\tests\web-platform\runtests.py', '--log-raw=-', '--log-raw=Z:\task_1565867685\build\blobber_upload_dir\wpt_raw.log', '--log-wptreport=Z:\task_1565867685\build\blobber_upload_dir\wptreport.json', '--log-errorsummary=Z:\task_1565867685\build\blobber_upload_dir\wpt_errorsummary.log', '--binary=Z:\task_1565867685\build\application\firefox\firefox.exe', '--symbols-path=Z:\task_1565867685\build\symbols', '--stackwalk-binary=Z:\task_1565867685\build\win32-minidump_stackwalk.exe', '--stackfix-dir=Z:\task_1565867685\build\tests\bin', '--run-by-dir=3', '--no-pause-after-test', '--test-type=reftest', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--stylo-threads=4', '--prefs-root=Z:\task_1565867685\build\tests\web-platform/prefs', '--processes=1', '--config=Z:\task_1565867685\build\tests\web-platform/wptrunner.ini', '--ca-cert-path=Z:\task_1565867685\build\tests\web-platform/tests/tools/certs/cacert.pem', '--host-key-path=Z:\task_1565867685\build\tests\web-platform/tests/tools/certs/web-platform.test.key', '--host-cert-path=Z:\task_1565867685\build\tests\web-platform/tests/tools/certs/web-platform.test.pem', '--certutil-binary=Z:\task_1565867685\build\tests/bin/certutil', '--verify-log-full', '--verify', u'tests/web-platform/tests/css/css-ui/webkit-appearance-textfield-001.html'] in Z:\task_1565867685\build
[task 2019-08-15T11:53:33.460Z] 11:53:33 INFO - Copy/paste: Z:\task_1565867685\build\venv\Scripts\python -u Z:\task_1565867685\build\tests\web-platform\runtests.py --log-raw=- --log-raw=Z:\task_1565867685\build\blobber_upload_dir\wpt_raw.log --log-wptreport=Z:\task_1565867685\build\blobber_upload_dir\wptreport.json --log-errorsummary=Z:\task_1565867685\build\blobber_upload_dir\wpt_errorsummary.log --binary=Z:\task_1565867685\build\application\firefox\firefox.exe --symbols-path=Z:\task_1565867685\build\symbols --stackwalk-binary=Z:\task_1565867685\build\win32-minidump_stackwalk.exe --stackfix-dir=Z:\task_1565867685\build\tests\bin --run-by-dir=3 --no-pause-after-test --test-type=reftest --setpref=media.peerconnection.mtransport_process=false --setpref=network.process.enabled=false --setpref=media.peerconnection.mtransport_process=false --setpref=network.process.enabled=false --stylo-threads=4 --prefs-root=Z:\task_1565867685\build\tests\web-platform/prefs --processes=1 --config=Z:\task_1565867685\build\tests\web-platform/wptrunner.ini --ca-cert-path=Z:\task_1565867685\build\tests\web-platform/tests/tools/certs/cacert.pem --host-key-path=Z:\task_1565867685\build\tests\web-platform/tests/tools/certs/web-platform.test.key --host-cert-path=Z:\task_1565867685\build\tests\web-platform/tests/tools/certs/web-platform.test.pem --certutil-binary=Z:\task_1565867685\build\tests/bin/certutil --verify-log-full --verify tests/web-platform/tests/css/css-ui/webkit-appearance-textfield-001.html
[task 2019-08-15T11:53:33.460Z] 11:53:33 INFO - Using env: (same as previous command)
[task 2019-08-15T11:53:33.460Z] 11:53:33 INFO - Calling ['Z:\task_1565867685\build\venv\Scripts\python', '-u', 'Z:\task_1565867685\build\tests\web-platform\runtests.py', '--log-raw=-', '--log-raw=Z:\task_1565867685\build\blobber_upload_dir\wpt_raw.log', '--log-wptreport=Z:\task_1565867685\build\blobber_upload_dir\wptreport.json', '--log-errorsummary=Z:\task_1565867685\build\blobber_upload_dir\wpt_errorsummary.log', '--binary=Z:\task_1565867685\build\application\firefox\firefox.exe', '--symbols-path=Z:\task_1565867685\build\symbols', '--stackwalk-binary=Z:\task_1565867685\build\win32-minidump_stackwalk.exe', '--stackfix-dir=Z:\task_1565867685\build\tests\bin', '--run-by-dir=3', '--no-pause-after-test', '--test-type=reftest', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--stylo-threads=4', '--prefs-root=Z:\task_1565867685\build\tests\web-platform/prefs', '--processes=1', '--config=Z:\task_1565867685\build\tests\web-platform/wptrunner.ini', '--ca-cert-path=Z:\task_1565867685\build\tests\web-platform/tests/tools/certs/cacert.pem', '--host-key-path=Z:\task_1565867685\build\tests\web-platform/tests/tools/certs/web-platform.test.key', '--host-cert-path=Z:\task_1565867685\build\tests\web-platform/tests/tools/certs/web-platform.test.pem', '--certutil-binary=Z:\task_1565867685\build\tests/bin/certutil', '--verify-log-full', '--verify', u'tests/web-platform/tests/css/css-ui/webkit-appearance-textfield-001.html'] with output_timeout 1000
[task 2019-08-15T11:53:33.803Z] 11:53:33 INFO - :::
[task 2019-08-15T11:53:33.803Z] 11:53:33 INFO - ::: Running test verification step "Running tests in a loop 10 times"...
[task 2019-08-15T11:53:33.803Z] 11:53:33 INFO - :::
[task 2019-08-15T11:53:34.106Z] 11:53:34 INFO - mozversion application_buildid: 20190815095133
[task 2019-08-15T11:53:34.106Z] 11:53:34 INFO - mozversion application_changeset: caf7bd7998b21577f3ddce32f8d794d60e1ba203
[task 2019-08-15T11:53:34.107Z] 11:53:34 INFO - mozversion application_display_name: Firefox Nightly
[task 2019-08-15T11:53:34.107Z] 11:53:34 INFO - mozversion application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
[task 2019-08-15T11:53:34.107Z] 11:53:34 INFO - mozversion application_name: Firefox
[task 2019-08-15T11:53:34.107Z] 11:53:34 INFO - mozversion application_remotingname: firefox
[task 2019-08-15T11:53:34.107Z] 11:53:34 INFO - mozversion application_repository: https://hg.mozilla.org/integration/autoland
[task 2019-08-15T11:53:34.107Z] 11:53:34 INFO - mozversion application_vendor: Mozilla
[task 2019-08-15T11:53:34.107Z] 11:53:34 INFO - mozversion application_version: 70.0a1
[task 2019-08-15T11:53:34.108Z] 11:53:34 INFO - mozversion platform_buildid: 20190815095133
[task 2019-08-15T11:53:34.108Z] 11:53:34 INFO - mozversion platform_changeset: caf7bd7998b21577f3ddce32f8d794d60e1ba203
[task 2019-08-15T11:53:34.108Z] 11:53:34 INFO - mozversion platform_repository: https://hg.mozilla.org/integration/autoland
[task 2019-08-15T11:53:34.108Z] 11:53:34 INFO - mozversion platform_version: 70.0a1
[task 2019-08-15T11:53:39.675Z] 11:53:39 INFO - Using 1 client processes
[task 2019-08-15T11:53:44.470Z] 11:53:44 INFO - SUITE-START | Running 1 tests

Note: this test was just added yesterday in bug 1573483.

Depends on: 1573483

The platform here was:

windows 7 debug test-windows7-32/debug-test-verify-wpt-e10s-1 (tvw1)

I think that matches the first line of the annotation in https://hg.mozilla.org/mozilla-central/rev/259ad71a99a1 :

if (os == "win") and debug and not webrender and (processor == "x86"): [FAIL, PASS]

That means we should allow the test to pass or fail on this platform without any trouble happening. Indeed, the log says:
TEST-KNOWN-INTERMITTENT-PASS

So this shouldn't be considered a failure -- the test is already annotated as intermittently passing/failing so there's no action to be taken here.

If this is causing orange on TreeHerder somewhere, we should consider that a bug in whatever piece of our infra is considering this an orange.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → INVALID

(In reply to Daniel Holbert [:dholbert] from comment #2)

If this is causing orange on TreeHerder somewhere, we should consider that a bug in whatever piece of our infra is considering this an orange.

I filed bug 1574355 on this.

You need to log in before you can comment on or make changes to this bug.