1414042 - Permaorange test-verify browser/extensions/shield-recipe-client/test/browser/browser_bootstrap.js | Pref test.initShieldPrefs1 don't exist before being initialized. - Got 128, expected 0

Status: RESOLVED INCOMPLETE

(Testing :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ebalazs [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=141759352&repo=autoland

https://queue.taskcluster.net/v1/task/cXOq66IGSuWe_XnHwBuf-g/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

16 failures in 116 pushes (0.138 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-central: 16

Platform breakdown:
* linux64: 4
* windows7-32: 3
* windows10-64: 3
* osx-10-10: 2
* windows7-32-nightly: 1
* windows10-64-nightly: 1
* macosx64-nightly: 1
* linux64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414042&startday=2017-11-03&endday=2017-11-03&tree=all

Comment 2

[Intermittent Failures Robot]

30 failures in 857 pushes (0.035 failures/push) were associated with this bug in the last 7 days.   

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-central: 22
* autoland: 8

Platform breakdown:
* windows7-32: 7
* windows10-64: 6
* linux64: 6
* osx-10-10: 5
* windows7-32-nightly: 2
* macosx64-nightly: 2
* windows10-64-nightly: 1
* linux64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414042&startday=2017-10-30&endday=2017-11-05&tree=all

Comment 3

[Geoff Brown [:gbrown]]

Test verification of browser_bootstrap.js was triggered by bug 1413643, which made substantial changes to this test.

test-verify only runs when a test is modified, so these failures won't happen again unless/until the test is modified.

I see no (other) intermittent failure bugs open for this test, so there's no pressing need for follow-up on this bug.


I can easily reproduce this failure locally with

  mach mochitest browser/extensions/shield-recipe-client/test/browser/browser_bootstrap.js --repeat 2

or

  mach mochitest browser/extensions/shield-recipe-client/test/browser/browser_bootstrap.js --verify

Failure to run with --repeat may indicate that the test fails to restore state...which might be troublesome for any other tests run in the same browser session.

Comment 4

[Intermittent Failures Robot]

18 failures in 849 pushes (0.021 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 10
* mozilla-inbound: 8

Platform breakdown:
* windows10-64: 7
* windows7-32: 6
* linux64: 3
* osx-10-10: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1414042&startday=2017-11-06&endday=2017-11-12&tree=all

Comment 5

[Geoff Brown [:gbrown]]

Test was updated again by bug 1416003, triggering more failures.

Comment 6

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup