1490981 - Perma tier2 devtools animation ccov devtools/client/inspector/animation/test/browser_animation_keyframes-progress-bar.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N)

Status: RESOLVED FIXED

(DevTools :: Inspector: Animations, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ebalazs [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=199008690&repo=mozilla-central

https://queue.taskcluster.net/v1/task/JicDXqMEQIibz_rCbEVHIw/runs/0/artifacts/public/logs/live_backing.log

TEST-PASS | devtools/client/inspector/animation/test/browser_animation_logic_scroll-amount.js | Scroll amount for animated property list should be less than previous state - 
[task 2018-08-10T06:37:34.834Z] 06:37:34     INFO - Leaving test bound 
[task 2018-08-10T06:37:34.835Z] 06:37:34     INFO - Buffered messages logged at 06:37:33
[task 2018-08-10T06:37:34.836Z] 06:37:34     INFO - Removing tab.
[task 2018-08-10T06:37:34.838Z] 06:37:34     INFO - Waiting for event: 'TabClose' on [object XULElement].
[task 2018-08-10T06:37:34.839Z] 06:37:34     INFO - Got event: 'TabClose' on [object XULElement].
[task 2018-08-10T06:37:34.840Z] 06:37:34     INFO - Tab removed and finished closing
[task 2018-08-10T06:37:34.841Z] 06:37:34     INFO - Buffered messages finished
[task 2018-08-10T06:37:34.842Z] 06:37:34     INFO - TEST-UNEXPECTED-FAIL | devtools/client/inspector/animation/test/browser_animation_logic_scroll-amount.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. - 
[task 2018-08-10T06:37:34.843Z] 06:37:34     INFO - GECKO(2078) | MEMORY STAT | vsize 2219MB | residentFast 490MB | heapAllocated 183MB
[task 2018-08-10T06:37:34.844Z] 06:37:34     INFO - TEST-OK | devtools/client/inspector/animation/test/browser_animation_logic_scroll-amount.js | took 111634ms
[task 2018-08-10T06:37:34.845Z] 06:37:34     INFO - GECKO(2078) | ++DOCSHELL 0x7f4eb6a78000 == 2 [pid = 2239] [id = {24148b02-d62e-4b4a-967f-4f5ad3e640e7}]
[task 2018-08-10T06:37:34.846Z] 06:37:34     INFO - GECKO(2078) | ++DOMWINDOW == 3 (0x7f4ebac0c800) [pid = 2239] [serial = 101] [outer = (nil)]
[task 2018-08-10T06:37:34.848Z] 06:37:34     INFO - GECKO(2078) | ++DOMWINDOW == 4 (0x7f4eb600cc00) [pid = 2239] [serial = 102] [outer = 0x7f4ebac0c800]
[task 2018-08-10T06:37:34.848Z] 06:37:34     INFO - GECKO(2078) | ++DOMWINDOW == 5 (0x7f4eb607b800) [pid = 2239] [serial = 103] [outer = 0x7f4ebac0c800]
[task 2018-08-10T06:37:34.850Z] 06:37:34     INFO - checking window state
[task 2018-08-10T06:37:34.851Z] 06:37:34     INFO - TEST-START | devtools/client/inspector/animation/test/browser_animation_pause-resume-button.js
[task 2018-08-10T06:37:34.852Z] 06:37:34     INFO - GECKO(2078) | ++DOCSHELL 0x7f7d38c70000 == 2 [pid = 2208] [id = {06d51628-b56c-4011-bb70-336a6de743b3}]
[task 2018-08-10T06:37:34.853Z] 06:37:34     INFO - GECKO(2078) | ++DOMWINDOW == 3 (0x7f7d3cf2c200) [pid = 2208] [serial = 104] [outer = (nil)]
[task 2018-08-10T06:37:34.854Z] 06:37:34     INFO - GECKO(2078) | ++DOMWINDOW == 4 (0x7f7d36451400) [pid = 2208] [serial = 105] [outer = 0x7f7d3cf2c200]
[task 2018-08-10T06:37:34.947Z] 06:37:34     INFO - GECKO(2078) | ++DOMWINDOW == 5 (0x7f7d36458c00) [pid = 2208] [serial = 106] [outer = 0x7f7d3cf2c200]
[task 2018-08-10T06:37:35.381Z] 06:37:35     INFO - GECKO(2078) | ++DOCSHELL 0x7fb92831d000 == 6 [pid = 2078] [id = {e30fc441-de44-4b03-8c34-6abc5f1731d8}]
[task 2018-08-10T06:37:35.383Z] 06:37:35     INFO - GECKO(2078) | ++DOMWINDOW == 134 (0x7fb92d7cce00) [pid = 2078] [serial = 509] [outer = (nil)]
[task 2018-08-10T06:37:35.385Z] 06:37:35     INFO - GECKO(2078) | ++DOMWINDOW == 135 (0x7fb92d795000) [pid = 2078] [serial = 510] [outer = 0x7fb92d7cce00]
[task 2018-08-10T06:37:35.545Z] 06:37:35     INFO - GECKO(2078) | ++DOMWINDOW == 136 (0x7fb9373e6400) [pid = 2078] [serial = 511] [outer = 0x7fb92d7cce00]
[task 2018-08-10T06:37:36.756Z] 06:37:36     INFO - GECKO(2078) | ++DOCSHELL 0x7fb928321800 == 7 [pid = 2078] [id = {ca406e69-b4dd-4d65-8f37-5a013ebc561f}]
[task 2018-08-10T06:37:36.758Z] 06:37:36     INFO - GECKO(2078) | ++DOMWINDOW == 137 (0x7fb946a17200) [pid = 2078] [serial = 512] [outer = (nil)]
[task 2018-08-10T06:37:36.760Z] 06:37:36     INFO - GECKO(2078) | ++DOMWINDOW == 138 (0x7fb945bbdc00) [pid = 2078] [serial = 513] [outer = 0x7fb946a17200]
[task 2018-08-10T06:37:36.940Z] 06:37:36     INFO - GECKO(2078) | ++DOCSHELL 0x7fb945b21000 == 8 [pid = 2078] [id = {5543676e-7dad-41ce-9015-a80f9013f491}]
[task 2018-08-10T06:37:36.943Z] 06:37:36     INFO - GECKO(2078) | ++DOMWINDOW == 139 (0x7fb9475aa200) [pid = 2078] [serial = 514] [outer = (nil)]
[task 2018-08-10T06:37:36.985Z] 06:37:36     INFO - GECKO(2078) | ++DOMWINDOW == 140 (0x7fb946e96400) [pid = 2078] [serial = 515] [outer = 0x7fb9475aa200]
[task 2018-08-10T06:37:37.813Z] 06:37:37     INFO - GECKO(2078) | ++DOCSHELL 0x7fb92e357000 == 9 [pid = 2078] [id = {281a8fa8-72e4-4512-a2eb-114350e77112}]
[task 2018-08-10T06:37:37.815Z] 06:37:37     INFO - GECKO(2078) | ++DOMWINDOW == 141 (0x7fb92d7d1200) [pid = 2078] [serial = 516] [outer = (nil)]
[task 2018-08-10T06:37:37.816Z] 06:37:37     INFO - GECKO(2078) | ++DOMWINDOW == 142 (0x7fb92d79a400) [pid = 2078] [serial = 517] [outer = 0x7fb92d7d1200]
[task 2018-08-10T06:37:37.930Z] 06:37:37     INFO - GECKO(2078) | ++DOCSHELL 0x7fb936fbf000 == 10 [pid = 2078] [id = {056bc3d4-ac28-4717-9117-25906f8e5e23}]
[task 2018-08-10T06:37:37.934Z] 06:37:37     INFO - GECKO(2078) | ++DOMWINDOW == 143 (0x7fb92e369a00) [pid = 2078] [serial = 518] [outer = (nil)]
[task 2018-08-10T06:37:38.388Z] 06:37:38     INFO - GECKO(2078) | ++DOMWINDOW == 144 (0x7fb92d7a0800) [pid = 2078] [serial = 519] [outer = 0x7fb92e369a00]
[task 2018-08-10T06:37:41.733Z] 06:37:41     INFO - GECKO(2078) | console.log: "[DISPATCH]"
[task 2018-08-10T06:37:41.996Z] 06:37:41     INFO - GECKO(2078) | console.log: "[DISPATCH]" "{\n  \"type\": \"UPDATE_SIDEBAR_SIZE\",\n  \"sidebarSize\": null\n}"
[task 2018-08-10T06:37:42.842Z] 06:37:42     INFO - GECKO(2078) | --DOMWINDOW == 4 (0x7f4ebac0bc00) [pid = 2239] [serial = 98] [outer = (nil)] [url = http://example.com/browser/devtools/client/inspector/animation/test/doc_simple_animation.html]
[task 2018-08-10T06:37:42.843Z] 06:37:42     INFO - GECKO(2078) | --DOCSHELL 0x7f4eb6a74800 == 1 [pid = 2239] [id = {c06c18fb-6cb9-43f8-9087-1f38f1de84a5}]
[task 2018-08-10T06:37:44.969Z] 06:37:44     INFO - GECKO(2078) | --DOMWINDOW == 4 (0x7f7d3cf2c400) [pid = 2208] [serial = 102] [outer = (nil)] [url = about:blank]
[task 2018-08-10T06:37:44.969Z] 06:37:44     INFO - GECKO(2078) | --DOCSHELL 0x7f7d38c74800 == 1 [pid = 2208] [id = {38418213-3b0d-4342-802f-c16cd1d5404d}]
[task 2018-08-10T06:37:44.993Z] 06:37:44     INFO - GECKO(2078) | console.log: "[DISPATCH]"
[task 2018-08-10T06:37:45.803Z] 06:37:45     INFO - GECKO(2078) | console.log: "[DISPATCH]"
[task 2018-08-10T06:37:46.826Z] 06:37:46     INFO - GECKO(2078) | --DOMWINDOW == 3 (0x7f4eb600cc00) [pid = 2239] [serial = 102] [outer = (nil)] [url = about:blank]
[task 2018-08-10T06:37:46.827Z] 06:37:46     INFO - GECKO(2078) | --DOMWINDOW == 2 (0x7f4eb6010800) [pid = 2239] [serial = 100] [outer = (nil)] [url = http://example.com/browser/devtools/client/inspector/animation/test/doc_simple_animation.html]
[task 2018-08-10T06:37:47.512Z] 06:37:47     INFO - GECKO(2078) | ++DOMWINDOW == 145 (0x7fb93ae98000) [pid = 2078] [serial = 520] [outer = 0x7fb92d7cce00]
[task 2018-08-10T06:37:50.163Z] 06:37:50     INFO - GECKO(2078) | --DOMWINDOW == 3 (0x7f7d36452000) [pid = 2208] [serial = 103] [outer = (nil)] [url = about:blank]
[task 2018-08-10T06:37:50.167Z] 06:37:50     INFO - GECKO(2078) | --DOMWINDOW == 2 (0x7f7d36451400) [pid = 2208] [serial = 105] [outer = (nil)] [url = about:blank]
[task 2018-08-10T06:37:51.885Z] 06:37:51     INFO - GECKO(2078) | --DOMWINDOW == 144 (0x7fb94deaf000) [pid = 2078] [serial = 503] [outer = (nil)] [url = about:blank]
[task 2018-08-10T06:37:52.151Z] 06:37:52     INFO - GECKO(2078) | --DOCSHELL 0x7fb936fbf000 == 9 [pid = 2078] [id = {056bc3d4-ac28-4717-9117-25906f8e5e23}]
[task 2018-08-10T06:37:52.153Z] 06:37:52     INFO - GECKO(2078) | --DOMWINDOW == 143 (0x7fb92d7d1200) [pid = 2078] [serial = 516] [outer = (nil)] [url = about:blank]
[task 2018-08-10T06:37:52.155Z] 06:37:52     INFO - GECKO(2078) | --DOCSHELL 0x7fb92e357000 == 8 [pid = 2078] [id = {281a8fa8-72e4-4512-a2eb-114350e77112}]
[task 2018-08-10T06:37:52.156Z] 06:37:52     INFO - GECKO(2078) | --DOCSHELL 0x7fb92831d000 == 7 [pid = 2078] [id = {e30fc441-de44-4b03-8c34-6abc5f1731d8}]
[task 2018-08-10T06:37:52.158Z] 06:37:52     INFO - GECKO(2078) | --DOCSHELL 0x7fb928321800 == 6 [pid = 2078] [id = {ca406e69-b4dd-4d65-8f37-5a013ebc561f}]
[task 2018-08-10T06:37:52.160Z] 06:37:52     INFO - GECKO(2078) | --DOCSHELL 0x7fb945b21000 == 5 [pid = 2078] [id = {5543676e-7dad-41ce-9015-a80f9013f491}]
[task 2018-08-10T06:37:52.161Z] 06:37:52     INFO - GECKO(2078) | --DOMWINDOW == 142 (0x7fb9475aa200) [pid = 2078] [serial = 514] [outer = (nil)] [url = about:blank]
[task 2018-08-10T06:37:52.236Z] 06:37:52     INFO - GECKO(2078) | MEMORY STAT | vsize 2218MB | residentFast 507MB | heapAllocated 198MB
[task 2018-08-10T06:37:52.239Z] 06:37:52     INFO - TEST-OK | devtools/client/inspector/animation/test/browser_animation_pause-resume-button.js | took 17735ms
[task 2018-08-10T06:37:52.258Z] 06:37:52     INFO - GECKO(2078) | ++DOCSHELL 0x7f7d38c74800 == 2 [pid = 2208] [id = {70d482f0-bb9b-4e5b-9a0a-22968005ebfc}]
[task 2018-08-10T06:37:52.261Z] 06:37:52     INFO - GECKO(2078) | ++DOMWINDOW == 3 (0x7f7d3cf2c400) [pid = 2208] [serial = 107] [outer = (nil)]
[task 2018-08-10T06:37:52.307Z] 06:37:52     INFO - GECKO(2078) | ++DOMWINDOW == 4 (0x7f7d36450000) [pid = 2208] [serial = 108] [outer = 0x7f7d3cf2c400]
[task 2018-08-10T06:37:52.367Z] 06:37:52     INFO - checking window state

Comment 1

[Intermittent Failures Robot]

30 failures in 2684 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #46 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 30

Platform breakdown:
* windows10-64-ccov: 30

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1490981&startday=2018-09-10&endday=2018-09-16&tree=all

Comment 2

[Brian Birtles (:birtles, Feb 26~ parental leave)]

Daisuke, it looks like this might need some attention.

Comment 3

[Daisuke Akatsuka (:daisuke)]

Thanks Brian, I'll take a look!

Hi Andreea!
We had not updated the codes that might relate to this test though, how should we address? Likewise, other tests that are timeouted on win ccov as well are depended on the test environment, I think.
To do all tests in this situation, we can only set requestLongerTimeout or split the test. Or if we disable those tests on win ccov, how much realm which is not verified will be? And, is this risky?

Comment 4

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Hi Greg, can you answer Daisuke's comments in comment 3, please?

Comment 5

[Greg Mierzwinski [:sparky]]

Hi :daisuke, on *ccov (code coverage) builds, tests take longer so they timeout often. We can try adding requestLongerTimeout with a value of 2. And if that doesn't work, we could disable this test on the windows10-64-ccov. If it gets disabled, we might lose a bit of windows-specific coverage data but that's it.

Comment 6

[Daisuke Akatsuka (:daisuke)]

Thank you for the understandable direction, Greg!
Since we already set requestLongerTimeout(3)[1] to this test, will disable on win ccov.
Also, I'll address along to this direction for other tests as well.

[1] https://searchfox.org/mozilla-central/source/devtools/client/inspector/animation/test/browser_animation_keyframes-progress-bar.js#12

Comment 7

[Daisuke Akatsuka (:daisuke)]

Attachment: Bug 1490981: Disable browser_animation_keyframes-progress-bar test on win ccov. r=sparky

Comment 8

[Greg Mierzwinski [:sparky]]

Comment on attachment 9010141 [details]
Bug 1490981: Disable browser_animation_keyframes-progress-bar test on win ccov. r=sparky

Greg Mierzwinski [:sparky] has approved the revision.

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/8f1ea035b4e3
Disable browser_animation_keyframes-progress-bar test on win ccov. r=sparky

Comment 10

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/8f1ea035b4e3

Comment 11

[Intermittent Failures Robot]

13 failures in 2902 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 13

Platform breakdown:
* windows10-64-ccov: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1490981&startday=2018-09-17&endday=2018-09-23&tree=all