Closed Bug 1461033 Opened 8 years ago Closed 1 year ago

Test-verify - Intermittent layout/style/test/test_media_queries.html | Test timed out.

Categories

(Core :: CSS Parsing and Computation, defect, P5)

Product:
Core
Component:
CSS Parsing and Computation
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

Bug 1461033 - Skip test_media_queries.html on verify for timeouts.
47 bytes, text/x-phabricator-request
Details | Review
Filed by: nerli [at] mozilla.com https://treeherder.mozilla.org/logviewer.html#?job_id=178099223&repo=autoland https://queue.taskcluster.net/v1/task/GUwrsRb4RNe8-p8vLFPchQ/runs/0/artifacts/public/logs/live_backing.log [task 2018-05-11T21:34:07.938Z] 21:34:07 INFO - 102 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out. [task 2018-05-11T21:34:07.939Z] 21:34:07 INFO - reportError@SimpleTest/TestRunner.js:121:7 [task 2018-05-11T21:34:07.939Z] 21:34:07 INFO - TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7 [task 2018-05-11T21:34:07.940Z] 21:34:07 INFO - 103 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(scan: interlace)' should not change serialization [task 2018-05-11T21:34:07.940Z] 21:34:07 INFO - 104 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(scan: interlace)' should NOT apply after cloning [task 2018-05-11T21:34:07.941Z] 21:34:07 INFO - 105 INFO TEST-OK | layout/style/test/test_media_queries.html | took 613994ms [task 2018-05-11T21:34:07.941Z] 21:34:07 INFO - 106 INFO None107 INFO TEST-START | Shutdown [task 2018-05-11T21:34:07.942Z] 21:34:07 INFO - 108 INFO Passed: 2127 [task 2018-05-11T21:34:07.942Z] 21:34:07 WARNING - 109 INFO Failed: 1 [task 2018-05-11T21:34:07.942Z] 21:34:07 WARNING - One or more unittests failed. [task 2018-05-11T21:34:07.943Z] 21:34:07 INFO - 110 INFO Todo: 0 [task 2018-05-11T21:34:07.943Z] 21:34:07 INFO - 111 INFO Mode: non-e10s [task 2018-05-11T21:34:07.944Z] 21:34:07 INFO - 112 INFO Slowest: 613985ms - /tests/layout/style/test/test_media_queries.html [task 2018-05-11T21:34:07.944Z] 21:34:07 INFO - 113 INFO TEST-INFO | Ran 1 Loops [task 2018-05-11T21:34:07.945Z] 21:34:07 INFO - 114 INFO SimpleTest FINISHED
Flags: needinfo?(emilio)
It's a slow-ish test, and I just extended it minimally. Is there something I'm supposed to do about this? (The needinfo request wasn't very self-explanatory). Thanks!
Flags: needinfo?(emilio)
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=183245633&repo=mozilla-inbound&lineNumber=1394 task 2018-06-15T00:11:16.940Z] 00:11:16 INFO - 101 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query 'not all and (-moz-is-glyph)' should NOT apply after cloning [task 2018-06-15T00:11:16.940Z] 00:11:16 INFO - Buffered messages finished [task 2018-06-15T00:11:16.940Z] 00:11:16 INFO - 102 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out. [task 2018-06-15T00:11:16.941Z] 00:11:16 INFO - reportError@SimpleTest/TestRunner.js:121:7 [task 2018-06-15T00:11:16.941Z] 00:11:16 INFO - TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7 [task 2018-06-15T00:11:16.942Z] 00:11:16 INFO - 103 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(-moz-is-glyph:0)' should not change serialization [task 2018-06-15T00:11:16.942Z] 00:11:16 INFO - 104 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(-moz-is-glyph:0)' should NOT apply after cloning [task 2018-06-15T00:11:16.942Z] 00:11:16 INFO - 105 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'not all and (-moz-is-glyph:1)' should not change serialization [task 2018-06-15T00:11:16.943Z] 00:11:16 INFO - 106 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query 'not all and (-moz-is-glyph:1)' should NOT apply after cloning
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 8 years ago → 7 years ago
Resolution: --- → INCOMPLETE
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=190926776&repo=autoland&lineNumber=1546 [task 2018-07-30T17:49:17.549Z] 17:49:17 INFO - 109 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(min-aspect-ratio: 59/79)' should not change serialization [task 2018-07-30T17:49:17.549Z] 17:49:17 INFO - 110 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(min-aspect-ratio: 59/79)' should NOT apply after cloning [task 2018-07-30T17:49:17.549Z] 17:49:17 INFO - Buffered messages finished [task 2018-07-30T17:49:17.550Z] 17:49:17 INFO - 111 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out. [task 2018-07-30T17:49:17.550Z] 17:49:17 INFO - reportError@SimpleTest/TestRunner.js:121:7 [task 2018-07-30T17:49:17.550Z] 17:49:17 INFO - TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7 [task 2018-07-30T17:49:17.551Z] 17:49:17 INFO - 112 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out. [task 2018-07-30T17:49:17.551Z] 17:49:17 INFO - reportError@SimpleTest/TestRunner.js:121:7 [task 2018-07-30T17:49:17.552Z] 17:49:17 INFO - TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7 [task 2018-07-30T17:49:17.552Z] 17:49:17 INFO - 113 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(max-aspect-ratio: 59/80)' should not change serialization [task 2018-07-30T17:49:17.553Z] 17:49:17 INFO - 114 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(max-aspect-ratio: 59/80)' should apply after cloning [task 2018-07-30T17:49:19.460Z] 17:49:19 INFO - 115 ERROR [SimpleTest.finish()] this test already called finish! [task 2018-07-30T17:49:19.461Z] 17:49:19 INFO - 116 INFO TEST-UNEXPECTED-ERROR | layout/style/test/test_media_queries.html | called finish() multiple times [task 2018-07-30T17:49:19.462Z] 17:49:19 INFO - TEST-INFO took 613560ms [task 2018-07-30T17:49:23.902Z] 17:49:23 INFO - 117 INFO TEST-OK | layout/style/test/test_media_queries.html [task 2018-07-30T17:49:28.242Z] 17:49:28 INFO - 118 INFO TEST-START | Shutdown [task 2018-07-30T17:49:28.243Z] 17:49:28 INFO - 119 INFO Passed: 6408 [task 2018-07-30T17:49:28.243Z] 17:49:28 WARNING - 120 INFO Failed: 3 [task 2018-07-30T17:49:28.243Z] 17:49:28 WARNING - One or more unittests failed. [task 2018-07-30T17:49:28.245Z] 17:49:28 INFO - 121 INFO Todo: 0 [task 2018-07-30T17:49:28.245Z] 17:49:28 INFO - 122 INFO Mode: non-e10s [task 2018-07-30T17:49:28.246Z] 17:49:28 INFO - 123 INFO Slowest: 617199ms - /tests/layout/style/test/test_media_queries.html [task 2018-07-30T17:49:28.246Z] 17:49:28 INFO - 124 INFO TEST-INFO | Ran 2 Loops [task 2018-07-30T17:49:28.246Z] 17:49:28 INFO - 125 INFO SimpleTest FINISHED [task 2018-07-30T17:49:44.302Z] 17:49:44 INFO - INFO | automation.py | Application ran for: 0:18:18.857909 [task 2018-07-30T17:49:44.302Z] 17:49:44 INFO - INFO | zombiecheck | Reading PID log: /tmp/tmpIaSYM8pidlog [task 2018-07-30T17:49:44.929Z] 17:49:44 INFO - /data/tombstones does not exist; tombstone check skipped [task 2018-07-30T17:49:45.451Z] 17:49:45 INFO - Stopping web server [task 2018-07-30T17:49:45.457Z] 17:49:45 INFO - Stopping web socket server [task 2018-07-30T17:49:45.477Z] 17:49:45 INFO - Stopping ssltunnel [task 2018-07-30T17:49:45.498Z] 17:49:45 INFO - leakcheck | refcount logging is off, so leaks can't be detected! [task 2018-07-30T17:49:45.499Z] 17:49:45 INFO - runtests.py | Running tests: end. [task 2018-07-30T17:49:46.236Z] 17:49:46 INFO - Buffered messages finished
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → INCOMPLETE
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=201467001&repo=autoland&lineNumber=1541 [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - Buffered messages logged at 17:54:28 [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 97 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(min-color-index: 0)' should not change serialization [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 98 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(min-color-index: 0)' should apply after cloning [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 99 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(min-color-index: 1)' should not change serialization [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 100 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(min-color-index: 1)' should NOT apply after cloning [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - Buffered messages logged at 17:54:29 [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 101 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(max-color-index: 0)' should not change serialization [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 102 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(max-color-index: 0)' should apply after cloning [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - Buffered messages logged at 17:54:30 [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 103 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(max-color-index: 1)' should not change serialization [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 104 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(max-color-index: 1)' should apply after cloning [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - Buffered messages logged at 17:54:31 [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 105 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(max-color-index: 157)' should not change serialization [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 106 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(max-color-index: 157)' should apply after cloning [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - Buffered messages logged at 17:54:33 [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 107 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution: 3dpi)' should not change serialization [task 2018-09-25T17:54:36.761Z] 17:54:36 INFO - 108 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution:3dpi)' should not change serialization [task 2018-09-25T17:54:36.762Z] 17:54:36 INFO - Buffered messages logged at 17:54:34 [task 2018-09-25T17:54:36.762Z] 17:54:36 INFO - 109 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution: 3.0dpi)' should not change serialization [task 2018-09-25T17:54:36.762Z] 17:54:36 INFO - Buffered messages logged at 17:54:35 [task 2018-09-25T17:54:36.762Z] 17:54:36 INFO - 110 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution: 3.4dpi)' should not change serialization [task 2018-09-25T17:54:36.762Z] 17:54:36 INFO - Buffered messages finished [task 2018-09-25T17:54:36.762Z] 17:54:36 INFO - 111 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out. [task 2018-09-25T17:54:36.762Z] 17:54:36 INFO - reportError@SimpleTest/TestRunner.js:121:7 [task 2018-09-25T17:54:36.762Z] 17:54:36 INFO - TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7 [task 2018-09-25T17:54:38.430Z] 17:54:38 INFO - 112 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution : 120dpcm)' should not change serialization [task 2018-09-25T17:54:38.432Z] 17:54:38 INFO - 113 INFO TEST-OK | layout/style/test/test_media_queries.html | took 616718ms [task 2018-09-25T17:54:40.147Z] 17:54:40 INFO - 114 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out. [task 2018-09-25T17:54:40.148Z] 17:54:40 INFO - reportError@SimpleTest/TestRunner.js:121:7 [task 2018-09-25T17:54:40.149Z] 17:54:40 INFO - TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7 [task 2018-09-25T17:54:46.895Z] 17:54:46 INFO - 115 ERROR [SimpleTest.finish()] this test already called finish! [task 2018-09-25T17:54:46.896Z] 17:54:46 INFO - 116 INFO TEST-UNEXPECTED-ERROR | layout/style/test/test_media_queries.html | called finish() multiple times [task 2018-09-25T17:54:46.896Z] 17:54:46 INFO - TEST-INFO [task 2018-09-25T17:54:46.896Z] 17:54:46 INFO - 117 INFO TEST-START | Shutdown [task 2018-09-25T17:54:46.896Z] 17:54:46 INFO - 118 INFO Passed: 6583 [task 2018-09-25T17:54:46.897Z] 17:54:46 WARNING - 119 INFO Failed: 2 [task 2018-09-25T17:54:46.897Z] 17:54:46 WARNING - One or more unittests failed. [task 2018-09-25T17:54:46.897Z] 17:54:46 INFO - 120 INFO Todo: 0 [task 2018-09-25T17:54:46.897Z] 17:54:46 INFO - 121 INFO Mode: non-e10s [task 2018-09-25T17:54:46.897Z] 17:54:46 INFO - 122 INFO Slowest: 616718ms - /tests/layout/style/test/test_media_queries.html [task 2018-09-25T17:54:46.897Z] 17:54:46 INFO - 123 INFO TEST-INFO | Ran 2 Loops [task 2018-09-25T17:54:46.897Z] 17:54:46 INFO - 124 INFO SimpleTest FINISHED [task 2018-09-25T17:55:04.924Z] 17:55:04 INFO - wait for org.mozilla.fennec_aurora complete; top activity=com.android.launcher [task 2018-09-25T17:55:05.129Z] 17:55:05 INFO - INFO | automation.py | Application ran for: 0:18:06.097512 [task 2018-09-25T17:55:05.129Z] 17:55:05 INFO - INFO | zombiecheck | Reading PID log: /tmp/tmpL3r79Vpidlog [task 2018-09-25T17:55:05.650Z] 17:55:05 INFO - /data/tombstones does not exist; tombstone check skipped [task 2018-09-25T17:55:06.169Z] 17:55:06 INFO - Stopping web server [task 2018-09-25T17:55:06.178Z] 17:55:06 INFO - Stopping web socket server [task 2018-09-25T17:55:06.198Z] 17:55:06 INFO - Stopping ssltunnel [task 2018-09-25T17:55:06.219Z] 17:55:06 INFO - leakcheck | refcount logging is off, so leaks can't be detected! [task 2018-09-25T17:55:06.220Z] 17:55:06 INFO - runtests.py | Running tests: end. [task 2018-09-25T17:55:06.951Z] 17:55:06 INFO - Buffered messages finished [task 2018-09-25T17:55:07.779Z] 17:55:07 INFO - 0 INFO TEST-START | Shutdown [task 2018-09-25T17:55:07.780Z] 17:55:07 INFO - 1 INFO Passed: 9938 [task 2018-09-25T17:55:07.780Z] 17:55:07 WARNING - 2 INFO Failed: 2 [task 2018-09-25T17:55:07.781Z] 17:55:07 WARNING - One or more unittests failed. [task 2018-09-25T17:55:07.781Z] 17:55:07 INFO - 3 INFO Todo: 0 [task 2018-09-25T17:55:07.781Z] 17:55:07 INFO - 4 INFO Mode: non-e10s [task 2018-09-25T17:55:07.781Z] 17:55:07 INFO - 5 INFO SimpleTest FINISHED [task 2018-09-25T17:55:07.782Z] 17:55:07 INFO - Buffered messages finished [task 2018-09-25T17:55:07.782Z] 17:55:07 INFO - SUITE-END | took 1094s [task 2018-09-25T17:55:07.782Z] 17:55:07 INFO - SUITE-START | Running 1 tests [task 2018-09-25T17:55:07.783Z] 17:55:07 INFO - ::: [task 2018-09-25T17:55:07.783Z] 17:55:07 INFO - ::: Test verification summary for: [task 2018-09-25T17:55:07.783Z] 17:55:07 INFO - ::: [task 2018-09-25T17:55:07.783Z] 17:55:07 INFO - ::: layout/style/test/test_media_queries.html [task 2018-09-25T17:55:07.784Z] 17:55:07 INFO - ::: [task 2018-09-25T17:55:07.784Z] 17:55:07 INFO - ::: 1. Run each test 10 times in one browser. : FAIL [task 2018-09-25T17:55:07.784Z] 17:55:07 INFO - ::: 2. Run each test 5 times in a new browser each time. : not run / incomplete [task 2018-09-25T17:55:07.785Z] 17:55:07 INFO - ::: 3. Run each test 10 times in one browser, in chaos mode. : not run / incomplete [task 2018-09-25T17:55:07.785Z] 17:55:07 INFO - ::: 4. Run each test 5 times in a new browser each time, in chaos mode. : not run / incomplete [task 2018-09-25T17:55:07.786Z] 17:55:07 INFO - ::: [task 2018-09-25T17:55:07.786Z] 17:55:07 INFO - ::: Test verification FAILED! [task 2018-09-25T17:55:07.787Z] 17:55:07 INFO - ::: [task 2018-09-25T17:55:07.787Z] 17:55:07 INFO - Buffered messages finished [task 2018-09-25T17:55:07.787Z] 17:55:07 INFO - SUITE-END | took 0s
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 7 years ago → 7 years ago
Resolution: --- → INCOMPLETE

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=222174658&repo=autoland&lineNumber=1535

[task 2019-01-16T10:41:45.618Z] 10:41:45 INFO - 102 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out.
[task 2019-01-16T10:41:45.619Z] 10:41:45 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:7
[task 2019-01-16T10:41:45.619Z] 10:41:45 INFO - reportError@SimpleTest/TestRunner.js:121:7
[task 2019-01-16T10:41:45.620Z] 10:41:45 INFO - TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7
[task 2019-01-16T10:41:45.620Z] 10:41:45 INFO - 103 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(device-height < 639px)' should not change serialization
[task 2019-01-16T10:41:45.621Z] 10:41:45 INFO - 104 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(device-height < 639px)' should NOT apply after cloning
[task 2019-01-16T10:41:45.621Z] 10:41:45 INFO - 105 INFO TEST-OK | layout/style/test/test_media_queries.html | took 611808ms
[task 2019-01-16T10:41:56.194Z] 10:41:56 INFO - 106 INFO TEST-START | Shutdown
[task 2019-01-16T10:41:56.194Z] 10:41:56 INFO - 107 INFO Passed: 2960
[task 2019-01-16T10:41:56.194Z] 10:41:56 WARNING - 108 INFO Failed: 1
[task 2019-01-16T10:41:56.194Z] 10:41:56 WARNING - One or more unittests failed.

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

This started occurring again when bug 1490344 landed. Martin can you take a look?

Flags: needinfo?(stransky)

This is expected... If the test times out in verify, it will only fail / timeout when the test is touched.

Joel, what's the best way to deal with this case, where the test times out on TV but doesn't normally? I don't think there's anything in the test that would make it stateful, but skipping it in TV seems unfortunate.

Flags: needinfo?(stransky) → needinfo?(jmaher)

unfortunately hundreds of tests are skipped in test-verify; if you can fix the test that would be desired, otherwise skipping it is the way forward. There are a few reasons why we would fail in test verify:

  1. the test depends on a browser state or a previous test in order to pass (this could be that the browser hasn't fully initialized)
  2. the test completes too fast and we don't get a chance to cleanup and shutdown the browser cleanly (this could be a factor of time or a test that runs after this testcase in a normal run)
  3. the test has internal state and when run multiple times it fails- this could also be that the test does something to the browser state and cannot run again
  4. some other reason I am not aware of!!
Flags: needinfo?(jmaher)

Emilio, what would you like to do here? Or should I ping someone else?

Flags: needinfo?(emilio)

Skip it is I guess.

Flags: needinfo?(emilio)
Pushed by ealvarez@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/5b224d4205b7 Skip test_media_queries.html on verify for timeouts. r=jmaher
Severity: normal → S3

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED
Closed: 7 years ago → 1 year ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: