Open Bug 1461033 Opened 5 years ago Updated 5 months ago

Test-verify - Intermittent layout/style/test/test_media_queries.html | Test timed out.

Categories

(Core :: CSS Parsing and Computation, defect, P5)

defect

Tracking

()

REOPENED

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure, leave-open)

Attachments

(1 file)

Filed by: nerli [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=178099223&repo=autoland

https://queue.taskcluster.net/v1/task/GUwrsRb4RNe8-p8vLFPchQ/runs/0/artifacts/public/logs/live_backing.log

[task 2018-05-11T21:34:07.938Z] 21:34:07     INFO -  102 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out.
[task 2018-05-11T21:34:07.939Z] 21:34:07     INFO -      reportError@SimpleTest/TestRunner.js:121:7
[task 2018-05-11T21:34:07.939Z] 21:34:07     INFO -      TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7
[task 2018-05-11T21:34:07.940Z] 21:34:07     INFO -  103 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(scan: interlace)' should not change serialization
[task 2018-05-11T21:34:07.940Z] 21:34:07     INFO -  104 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(scan: interlace)' should NOT apply after cloning
[task 2018-05-11T21:34:07.941Z] 21:34:07     INFO -  105 INFO TEST-OK | layout/style/test/test_media_queries.html | took 613994ms
[task 2018-05-11T21:34:07.941Z] 21:34:07     INFO -  106 INFO None107 INFO TEST-START | Shutdown
[task 2018-05-11T21:34:07.942Z] 21:34:07     INFO -  108 INFO Passed:  2127
[task 2018-05-11T21:34:07.942Z] 21:34:07  WARNING -  109 INFO Failed:  1
[task 2018-05-11T21:34:07.942Z] 21:34:07  WARNING -  One or more unittests failed.
[task 2018-05-11T21:34:07.943Z] 21:34:07     INFO -  110 INFO Todo:    0
[task 2018-05-11T21:34:07.943Z] 21:34:07     INFO -  111 INFO Mode:    non-e10s
[task 2018-05-11T21:34:07.944Z] 21:34:07     INFO -  112 INFO Slowest: 613985ms - /tests/layout/style/test/test_media_queries.html
[task 2018-05-11T21:34:07.944Z] 21:34:07     INFO -  113 INFO TEST-INFO | Ran 1 Loops
[task 2018-05-11T21:34:07.945Z] 21:34:07     INFO -  114 INFO SimpleTest FINISHED
Flags: needinfo?(emilio)
It's a slow-ish test, and I just extended it minimally. Is there something I'm supposed to do about this? (The needinfo request wasn't very self-explanatory). Thanks!
Flags: needinfo?(emilio)
Recent failure log:
https://treeherder.mozilla.org/logviewer.html#?job_id=183245633&repo=mozilla-inbound&lineNumber=1394
task 2018-06-15T00:11:16.940Z] 00:11:16     INFO -  101 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query 'not all and (-moz-is-glyph)' should NOT apply after cloning
[task 2018-06-15T00:11:16.940Z] 00:11:16     INFO -  Buffered messages finished
[task 2018-06-15T00:11:16.940Z] 00:11:16     INFO -  102 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out.
[task 2018-06-15T00:11:16.941Z] 00:11:16     INFO -      reportError@SimpleTest/TestRunner.js:121:7
[task 2018-06-15T00:11:16.941Z] 00:11:16     INFO -      TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7
[task 2018-06-15T00:11:16.942Z] 00:11:16     INFO -  103 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(-moz-is-glyph:0)' should not change serialization
[task 2018-06-15T00:11:16.942Z] 00:11:16     INFO -  104 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(-moz-is-glyph:0)' should NOT apply after cloning
[task 2018-06-15T00:11:16.942Z] 00:11:16     INFO -  105 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'not all and (-moz-is-glyph:1)' should not change serialization
[task 2018-06-15T00:11:16.943Z] 00:11:16     INFO -  106 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query 'not all and (-moz-is-glyph:1)' should NOT apply after cloning
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 5 years ago5 years ago
Resolution: --- → INCOMPLETE
Recent failure log: 
https://treeherder.mozilla.org/logviewer.html#?job_id=190926776&repo=autoland&lineNumber=1546

[task 2018-07-30T17:49:17.549Z] 17:49:17     INFO -  109 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(min-aspect-ratio: 59/79)' should not change serialization
[task 2018-07-30T17:49:17.549Z] 17:49:17     INFO -  110 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(min-aspect-ratio: 59/79)' should NOT apply after cloning
[task 2018-07-30T17:49:17.549Z] 17:49:17     INFO -  Buffered messages finished
[task 2018-07-30T17:49:17.550Z] 17:49:17     INFO -  111 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out.
[task 2018-07-30T17:49:17.550Z] 17:49:17     INFO -      reportError@SimpleTest/TestRunner.js:121:7
[task 2018-07-30T17:49:17.550Z] 17:49:17     INFO -      TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7
[task 2018-07-30T17:49:17.551Z] 17:49:17     INFO -  112 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out.
[task 2018-07-30T17:49:17.551Z] 17:49:17     INFO -      reportError@SimpleTest/TestRunner.js:121:7
[task 2018-07-30T17:49:17.552Z] 17:49:17     INFO -      TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7
[task 2018-07-30T17:49:17.552Z] 17:49:17     INFO -  113 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(max-aspect-ratio: 59/80)' should not change serialization
[task 2018-07-30T17:49:17.553Z] 17:49:17     INFO -  114 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(max-aspect-ratio: 59/80)' should apply after cloning
[task 2018-07-30T17:49:19.460Z] 17:49:19     INFO -  115 ERROR [SimpleTest.finish()] this test already called finish!
[task 2018-07-30T17:49:19.461Z] 17:49:19     INFO -  116 INFO TEST-UNEXPECTED-ERROR | layout/style/test/test_media_queries.html | called finish() multiple times
[task 2018-07-30T17:49:19.462Z] 17:49:19     INFO -  TEST-INFO took 613560ms
[task 2018-07-30T17:49:23.902Z] 17:49:23     INFO -  117 INFO TEST-OK | layout/style/test/test_media_queries.html
[task 2018-07-30T17:49:28.242Z] 17:49:28     INFO -  118 INFO TEST-START | Shutdown
[task 2018-07-30T17:49:28.243Z] 17:49:28     INFO -  119 INFO Passed:  6408
[task 2018-07-30T17:49:28.243Z] 17:49:28  WARNING -  120 INFO Failed:  3
[task 2018-07-30T17:49:28.243Z] 17:49:28  WARNING -  One or more unittests failed.
[task 2018-07-30T17:49:28.245Z] 17:49:28     INFO -  121 INFO Todo:    0
[task 2018-07-30T17:49:28.245Z] 17:49:28     INFO -  122 INFO Mode:    non-e10s
[task 2018-07-30T17:49:28.246Z] 17:49:28     INFO -  123 INFO Slowest: 617199ms - /tests/layout/style/test/test_media_queries.html
[task 2018-07-30T17:49:28.246Z] 17:49:28     INFO -  124 INFO TEST-INFO | Ran 2 Loops
[task 2018-07-30T17:49:28.246Z] 17:49:28     INFO -  125 INFO SimpleTest FINISHED
[task 2018-07-30T17:49:44.302Z] 17:49:44     INFO -  INFO | automation.py | Application ran for: 0:18:18.857909
[task 2018-07-30T17:49:44.302Z] 17:49:44     INFO -  INFO | zombiecheck | Reading PID log: /tmp/tmpIaSYM8pidlog
[task 2018-07-30T17:49:44.929Z] 17:49:44     INFO -  /data/tombstones does not exist; tombstone check skipped
[task 2018-07-30T17:49:45.451Z] 17:49:45     INFO -  Stopping web server
[task 2018-07-30T17:49:45.457Z] 17:49:45     INFO -  Stopping web socket server
[task 2018-07-30T17:49:45.477Z] 17:49:45     INFO -  Stopping ssltunnel
[task 2018-07-30T17:49:45.498Z] 17:49:45     INFO -  leakcheck | refcount logging is off, so leaks can't be detected!
[task 2018-07-30T17:49:45.499Z] 17:49:45     INFO -  runtests.py | Running tests: end.
[task 2018-07-30T17:49:46.236Z] 17:49:46     INFO -  Buffered messages finished
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 5 years ago5 years ago
Resolution: --- → INCOMPLETE
Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=201467001&repo=autoland&lineNumber=1541

[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  Buffered messages logged at 17:54:28
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  97 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(min-color-index: 0)' should not change serialization
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  98 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(min-color-index: 0)' should apply after cloning
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  99 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(min-color-index: 1)' should not change serialization
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  100 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(min-color-index: 1)' should NOT apply after cloning
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  Buffered messages logged at 17:54:29
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  101 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(max-color-index: 0)' should not change serialization
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  102 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(max-color-index: 0)' should apply after cloning
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  Buffered messages logged at 17:54:30
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  103 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(max-color-index: 1)' should not change serialization
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  104 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(max-color-index: 1)' should apply after cloning
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  Buffered messages logged at 17:54:31
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  105 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(max-color-index: 157)' should not change serialization
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  106 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(max-color-index: 157)' should apply after cloning
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  Buffered messages logged at 17:54:33
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  107 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution: 3dpi)' should not change serialization
[task 2018-09-25T17:54:36.761Z] 17:54:36     INFO -  108 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution:3dpi)' should not change serialization
[task 2018-09-25T17:54:36.762Z] 17:54:36     INFO -  Buffered messages logged at 17:54:34
[task 2018-09-25T17:54:36.762Z] 17:54:36     INFO -  109 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution: 3.0dpi)' should not change serialization
[task 2018-09-25T17:54:36.762Z] 17:54:36     INFO -  Buffered messages logged at 17:54:35
[task 2018-09-25T17:54:36.762Z] 17:54:36     INFO -  110 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution: 3.4dpi)' should not change serialization
[task 2018-09-25T17:54:36.762Z] 17:54:36     INFO -  Buffered messages finished
[task 2018-09-25T17:54:36.762Z] 17:54:36     INFO -  111 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out.
[task 2018-09-25T17:54:36.762Z] 17:54:36     INFO -      reportError@SimpleTest/TestRunner.js:121:7
[task 2018-09-25T17:54:36.762Z] 17:54:36     INFO -      TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7
[task 2018-09-25T17:54:38.430Z] 17:54:38     INFO -  112 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query 'all and (resolution	: 120dpcm)' should not change serialization
[task 2018-09-25T17:54:38.432Z] 17:54:38     INFO -  113 INFO TEST-OK | layout/style/test/test_media_queries.html | took 616718ms
[task 2018-09-25T17:54:40.147Z] 17:54:40     INFO -  114 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out.
[task 2018-09-25T17:54:40.148Z] 17:54:40     INFO -      reportError@SimpleTest/TestRunner.js:121:7
[task 2018-09-25T17:54:40.149Z] 17:54:40     INFO -      TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7
[task 2018-09-25T17:54:46.895Z] 17:54:46     INFO -  115 ERROR [SimpleTest.finish()] this test already called finish!
[task 2018-09-25T17:54:46.896Z] 17:54:46     INFO -  116 INFO TEST-UNEXPECTED-ERROR | layout/style/test/test_media_queries.html | called finish() multiple times
[task 2018-09-25T17:54:46.896Z] 17:54:46     INFO -  TEST-INFO
[task 2018-09-25T17:54:46.896Z] 17:54:46     INFO -  117 INFO TEST-START | Shutdown
[task 2018-09-25T17:54:46.896Z] 17:54:46     INFO -  118 INFO Passed:  6583
[task 2018-09-25T17:54:46.897Z] 17:54:46  WARNING -  119 INFO Failed:  2
[task 2018-09-25T17:54:46.897Z] 17:54:46  WARNING -  One or more unittests failed.
[task 2018-09-25T17:54:46.897Z] 17:54:46     INFO -  120 INFO Todo:    0
[task 2018-09-25T17:54:46.897Z] 17:54:46     INFO -  121 INFO Mode:    non-e10s
[task 2018-09-25T17:54:46.897Z] 17:54:46     INFO -  122 INFO Slowest: 616718ms - /tests/layout/style/test/test_media_queries.html
[task 2018-09-25T17:54:46.897Z] 17:54:46     INFO -  123 INFO TEST-INFO | Ran 2 Loops
[task 2018-09-25T17:54:46.897Z] 17:54:46     INFO -  124 INFO SimpleTest FINISHED
[task 2018-09-25T17:55:04.924Z] 17:55:04     INFO -  wait for org.mozilla.fennec_aurora complete; top activity=com.android.launcher
[task 2018-09-25T17:55:05.129Z] 17:55:05     INFO -  INFO | automation.py | Application ran for: 0:18:06.097512
[task 2018-09-25T17:55:05.129Z] 17:55:05     INFO -  INFO | zombiecheck | Reading PID log: /tmp/tmpL3r79Vpidlog
[task 2018-09-25T17:55:05.650Z] 17:55:05     INFO -  /data/tombstones does not exist; tombstone check skipped
[task 2018-09-25T17:55:06.169Z] 17:55:06     INFO -  Stopping web server
[task 2018-09-25T17:55:06.178Z] 17:55:06     INFO -  Stopping web socket server
[task 2018-09-25T17:55:06.198Z] 17:55:06     INFO -  Stopping ssltunnel
[task 2018-09-25T17:55:06.219Z] 17:55:06     INFO -  leakcheck | refcount logging is off, so leaks can't be detected!
[task 2018-09-25T17:55:06.220Z] 17:55:06     INFO -  runtests.py | Running tests: end.
[task 2018-09-25T17:55:06.951Z] 17:55:06     INFO -  Buffered messages finished
[task 2018-09-25T17:55:07.779Z] 17:55:07     INFO -  0 INFO TEST-START | Shutdown
[task 2018-09-25T17:55:07.780Z] 17:55:07     INFO -  1 INFO Passed:  9938
[task 2018-09-25T17:55:07.780Z] 17:55:07  WARNING -  2 INFO Failed:  2
[task 2018-09-25T17:55:07.781Z] 17:55:07  WARNING -  One or more unittests failed.
[task 2018-09-25T17:55:07.781Z] 17:55:07     INFO -  3 INFO Todo:    0
[task 2018-09-25T17:55:07.781Z] 17:55:07     INFO -  4 INFO Mode:    non-e10s
[task 2018-09-25T17:55:07.781Z] 17:55:07     INFO -  5 INFO SimpleTest FINISHED
[task 2018-09-25T17:55:07.782Z] 17:55:07     INFO -  Buffered messages finished
[task 2018-09-25T17:55:07.782Z] 17:55:07     INFO -  SUITE-END | took 1094s
[task 2018-09-25T17:55:07.782Z] 17:55:07     INFO -  SUITE-START | Running 1 tests
[task 2018-09-25T17:55:07.783Z] 17:55:07     INFO -  :::
[task 2018-09-25T17:55:07.783Z] 17:55:07     INFO -  ::: Test verification summary for:
[task 2018-09-25T17:55:07.783Z] 17:55:07     INFO -  :::
[task 2018-09-25T17:55:07.783Z] 17:55:07     INFO -  ::: layout/style/test/test_media_queries.html
[task 2018-09-25T17:55:07.784Z] 17:55:07     INFO -  :::
[task 2018-09-25T17:55:07.784Z] 17:55:07     INFO -  ::: 1. Run each test 10 times in one browser. : FAIL
[task 2018-09-25T17:55:07.784Z] 17:55:07     INFO -  ::: 2. Run each test 5 times in a new browser each time. : not run / incomplete
[task 2018-09-25T17:55:07.785Z] 17:55:07     INFO -  ::: 3. Run each test 10 times in one browser, in chaos mode. : not run / incomplete
[task 2018-09-25T17:55:07.785Z] 17:55:07     INFO -  ::: 4. Run each test 5 times in a new browser each time, in chaos mode. : not run / incomplete
[task 2018-09-25T17:55:07.786Z] 17:55:07     INFO -  :::
[task 2018-09-25T17:55:07.786Z] 17:55:07     INFO -  ::: Test verification FAILED!
[task 2018-09-25T17:55:07.787Z] 17:55:07     INFO -  :::
[task 2018-09-25T17:55:07.787Z] 17:55:07     INFO -  Buffered messages finished
[task 2018-09-25T17:55:07.787Z] 17:55:07     INFO -  SUITE-END | took 0s
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 5 years ago4 years ago
Resolution: --- → INCOMPLETE

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=222174658&repo=autoland&lineNumber=1535

[task 2019-01-16T10:41:45.618Z] 10:41:45 INFO - 102 INFO TEST-UNEXPECTED-FAIL | layout/style/test/test_media_queries.html | Test timed out.
[task 2019-01-16T10:41:45.619Z] 10:41:45 INFO - SimpleTest.ok@SimpleTest/SimpleTest.js:275:7
[task 2019-01-16T10:41:45.619Z] 10:41:45 INFO - reportError@SimpleTest/TestRunner.js:121:7
[task 2019-01-16T10:41:45.620Z] 10:41:45 INFO - TestRunner._checkForHangs@SimpleTest/TestRunner.js:142:7
[task 2019-01-16T10:41:45.620Z] 10:41:45 INFO - 103 INFO TEST-PASS | layout/style/test/test_media_queries.html | cloning query '(device-height < 639px)' should not change serialization
[task 2019-01-16T10:41:45.621Z] 10:41:45 INFO - 104 INFO TEST-PASS | layout/style/test/test_media_queries.html | Media query '(device-height < 639px)' should NOT apply after cloning
[task 2019-01-16T10:41:45.621Z] 10:41:45 INFO - 105 INFO TEST-OK | layout/style/test/test_media_queries.html | took 611808ms
[task 2019-01-16T10:41:56.194Z] 10:41:56 INFO - 106 INFO TEST-START | Shutdown
[task 2019-01-16T10:41:56.194Z] 10:41:56 INFO - 107 INFO Passed: 2960
[task 2019-01-16T10:41:56.194Z] 10:41:56 WARNING - 108 INFO Failed: 1
[task 2019-01-16T10:41:56.194Z] 10:41:56 WARNING - One or more unittests failed.

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

This started occurring again when bug 1490344 landed. Martin can you take a look?

Flags: needinfo?(stransky)

This is expected... If the test times out in verify, it will only fail / timeout when the test is touched.

Joel, what's the best way to deal with this case, where the test times out on TV but doesn't normally? I don't think there's anything in the test that would make it stateful, but skipping it in TV seems unfortunate.

Flags: needinfo?(stransky) → needinfo?(jmaher)

unfortunately hundreds of tests are skipped in test-verify; if you can fix the test that would be desired, otherwise skipping it is the way forward. There are a few reasons why we would fail in test verify:

  1. the test depends on a browser state or a previous test in order to pass (this could be that the browser hasn't fully initialized)
  2. the test completes too fast and we don't get a chance to cleanup and shutdown the browser cleanly (this could be a factor of time or a test that runs after this testcase in a normal run)
  3. the test has internal state and when run multiple times it fails- this could also be that the test does something to the browser state and cannot run again
  4. some other reason I am not aware of!!
Flags: needinfo?(jmaher)

Emilio, what would you like to do here? Or should I ping someone else?

Flags: needinfo?(emilio)

Skip it is I guess.

Flags: needinfo?(emilio)
Pushed by ealvarez@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/5b224d4205b7
Skip test_media_queries.html on verify for timeouts. r=jmaher
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.