1354415 - Intermittent browser/base/content/test/webextensions/browser_extension_update_background.js | This test exceeded the timeout threshold. It should be rewritten or split up. If that's not possible, use requestLongerTimeout(N), but only as a last resort. -

Status: RESOLVED FIXED

(WebExtensions :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=89286961&repo=autoland

https://queue.taskcluster.net/v1/task/NuRCxbM6QOmC20T1TcWesw/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

8 failures in 894 pushes (0.009 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 4
* autoland: 3
* try: 1

Platform breakdown:
* linux32: 5
* linux64: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354415&startday=2017-04-10&endday=2017-04-16&tree=all

Comment 2

[Intermittent Failures Robot]

25 failures in 817 pushes (0.031 failures/push) were associated with this bug in the last 7 days. 

This is the #45 most frequent failure this week.  

Repository breakdown:
* mozilla-inbound: 8
* mozilla-central: 7
* autoland: 6
* graphics: 4

Platform breakdown:
* linux32: 18
* linux64: 7

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354415&startday=2017-04-17&endday=2017-04-23&tree=all

Comment 3

[Geoff Brown [:gbrown]]

Attachment: requestLongerTimeout

This test was timing out in bug 1341337; I split out browser_extension_update_background_noprompt.js and that seemed to help for a few days, but then time outs started again.

Test durations for browser/base/content/test/webextensions/browser_extension_update_background.js on mozilla-central,mozilla-inbound,autoland between 2017-04-19 and 2017-04-26
linux32/debug-chunked:          71.04 s (51.57 s - 90.83 s over 348 runs)
linux32/debug-e10s:             73.20 s (58.39 s - 90.83 s over 147 runs)
linux32/opt-chunked:            19.63 s (12.25 s - 42.70 s over 560 runs)
linux32/opt-e10s:               20.90 s (14.95 s - 42.70 s over 214 runs)
linux64/asan-chunked:           33.56 s (21.60 s - 66.03 s over 583 runs)
linux64/asan-e10s:              37.02 s (26.39 s - 66.03 s over 220 runs)
linux64/debug-chunked:          69.84 s (48.25 s - 91.44 s over 305 runs)
linux64/debug-e10s:             70.64 s (50.36 s - 86.82 s over 147 runs)
linux64/opt-chunked:            18.93 s (12.52 s - 41.06 s over 302 runs)
linux64/opt-e10s:               20.46 s (13.65 s - 38.06 s over 147 runs)
linux64/pgo-chunked:            17.49 s (8.43 s - 43.26 s over 384 runs)
linux64/pgo-e10s:               17.74 s (12.37 s - 43.26 s over 225 runs)

Test durations for browser/base/content/test/webextensions/browser_extension_update_background_noprompt.js on mozilla-central,mozilla-inbound,autoland between 2017-04-19 and 2017-04-26
linux32/debug-chunked:          26.02 s (14.62 s - 46.28 s over 362 runs)
linux32/debug-e10s:             28.88 s (20.39 s - 46.28 s over 156 runs)
linux32/opt-chunked:            10.30 s (4.27 s - 38.93 s over 560 runs)
linux32/opt-e10s:               10.78 s (6.26 s - 38.93 s over 214 runs)
linux64/asan-chunked:           15.17 s (7.65 s - 32.24 s over 583 runs)
linux64/asan-e10s:              17.60 s (12.02 s - 32.24 s over 220 runs)
linux64/debug-chunked:          24.97 s (14.81 s - 55.54 s over 310 runs)
linux64/debug-e10s:             26.95 s (18.04 s - 55.54 s over 151 runs)
linux64/opt-chunked:            10.01 s (3.84 s - 29.36 s over 303 runs)
linux64/opt-e10s:               11.22 s (6.02 s - 29.36 s over 147 runs)
linux64/pgo-chunked:             9.71 s (3.33 s - 30.03 s over 384 runs)
linux64/pgo-e10s:               10.36 s (5.27 s - 28.42 s over 225 runs)

All the failure logs I have checked show the test making progress just before the time out, so I think allowing more time will be effective.

If you'd prefer to optimize or split the test further, that's fine with me, but please re-assign the bug.

Comment 4

[Andrew Swan [:aswan]]

Comment on attachment 8861966 [details] [diff] [review]
requestLongerTimeout

Review of attachment 8861966 [details] [diff] [review]:
-----------------------------------------------------------------

I'll try to look more closely and get a better permanent solution soon, but in the meantime, thanks for this...

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/d16f51ca4750
requestLongerTimeout for browser_extension_update_background.js; r=aswan

Comment 6

[Geoff Brown [:gbrown]]

(In reply to Andrew Swan [:aswan] from comment #4)
> I'll try to look more closely and get a better permanent solution soon,

That's great. I'll leave-open and re-assign to keep this on your radar.

Comment 7

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/d16f51ca4750

Comment 8

[Intermittent Failures Robot]

13 failures in 883 pushes (0.015 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 6
* autoland: 4
* mozilla-central: 2
* graphics: 1

Platform breakdown:
* linux32: 10
* linux64: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1354415&startday=2017-04-24&endday=2017-04-30&tree=all

Comment 9

[BugBot [:suhaib / :marco/ :calixte]]

The leave-open keyword is there and there is no activity for 6 months.
:ddurst, maybe it's time to close this bug?