1504191 - [meta] Frequent browser/components/urlbar/tests/browser/browser_UrlbarInput_tooltip.js | Test timed out - when Gecko 65 merges to Beta on 2018-12-03

Status: VERIFIED FIXED

(Firefox :: Address Bar, defect, P1)

Description

[Eliza Balazs [:ebalazs_]]

[Tracking Requested - why for this release]:

Central as Beta:
https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=00309ff27eb0d492465bfdd63ba422693629d629&selectedJob=209401752

Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=209400721&repo=try&lineNumber=2539

This is a regression from one of the following bugs:
https://bugzilla.mozilla.org/show_bug.cgi?id=1503689
https://bugzilla.mozilla.org/show_bug.cgi?id=1496443

dao: Can you have a look at this? Thank you!

Comment 1

[Andreea Pavel [:apavel]]

Aryx: i don't think this is perma-failing, i think it's just an intermittent failure with a higher occurance rate, an "almost perma-failure" as you put it: 

https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=00309ff27eb0d492465bfdd63ba422693629d629&searchStr=os%2Cx%2C10.10%2Cdevedition%2Copt%2Cmochitests%2Cwith%2Ce10s%2Ctest-macosx64-devedition%2Fopt-mochitest-browser-chrome-e10s-2%2Cm-e10s%28bc2%29&selectedJob=209402181

and

https://treeherder.mozilla.org/#/jobs?repo=try&revision=00309ff27eb0d492465bfdd63ba422693629d629&searchStr=browser%2Cchrome&group_state=expanded&selectedJob=209401752

How do we proceed in this case? Please take a look. 

Thank you.

Comment 2

[Intermittent Failures Robot]

4 failures in 3007 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 4

Platform breakdown:
* windows10-64: 1
* macosx64-nightly: 2
* macosx64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504191&startday=2018-11-05&endday=2018-11-11&tree=all

Comment 3

[Intermittent Failures Robot]

12 failures in 2917 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 12

Platform breakdown:
* windows7-32: 2
* macosx64-devedition: 1
* linux32-nightly: 1
* windows7-32-devedition: 1
* linux64: 1
* windows10-64: 1
* macosx64-nightly: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504191&startday=2018-11-12&endday=2018-11-18&tree=all

Comment 4

[Intermittent Failures Robot]

3 failures in 2387 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 3

Platform breakdown:
* windows7-32: 1
* linux64: 1
* macosx64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504191&startday=2018-11-19&endday=2018-11-25&tree=all

Comment 5

[Dão Gottwald [:dao]]

Any change after bug 1510599?

Comment 6

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Situation is unchanged, e.g. https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cusercancel%2Crunnable&selectedJob=214720548&searchStr=browser-chrome&revision=8380e5b932850371f9db03ed88de142065721626 has hit this at least 5 times.

Comment 7

[Dão Gottwald [:dao]]

The patch in bug 1504872 seems to mostly fix this for me running test-verify locally, although I still get a timeout (bug 1504985) once in a blue moon.

Comment 8

[Dão Gottwald [:dao]]

Can we close this?

Comment 9

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Unfortunately not. This beta sim from today has the failure at least 5 times: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=52633d87490f2e35089f6e71adbd3d4f6567b905&searchStr=browser-chrome&selectedJob=215073408

Comment 10

[Intermittent Failures Robot]

13 failures in 2808 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 13

Platform breakdown:
* linux32: 1
* windows7-32-devedition: 5
* macosx64-devedition: 1
* linux64: 1
* windows10-64: 3
* windows10-64-devedition: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504191&startday=2018-11-26&endday=2018-12-02&tree=all

Comment 11

[Dão Gottwald [:dao]]

How about now?

Comment 12

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

3 failures each on both early and late beta today.

Comment 13

[Dão Gottwald [:dao]]

(In reply to Sebastian Hengst [:aryx] (needinfo on intermittent or backout) from comment #12)
> 3 failures each on both early and late beta today.

Do you have a link?

Comment 14

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Early beta: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=3a1d00a6060a34a9edc570f15ca56b6612fe0f86
Late beta: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=802a8f9692bbff33a8c217b11a7afbf0fdb59379
Beta simulations are started daily between noon and early afternoon CET and added to https://docs.google.com/document/d/1826JIk4zfT1fXt115Blvho635bjsGjR7KO0dVq3yBn8/

Comment 15

[Eliza Balazs [:ebalazs_]]

Verified fixed with yesterday's beta simulation: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Crunnable&revision=5c1b6ea3a66973533948f008a1828ec8a0cb589b

Comment 16

[Intermittent Failures Robot]

18 failures in 1862 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 11
* mozilla-beta: 7

Platform breakdown:
* linux32-devedition: 6
* osx-10-10: 5
* linux64-devedition: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1504191&startday=2018-12-03&endday=2018-12-09&tree=all