994686 - Permaorange nightly-only failure in browser_experiments.js | Experiment tab hidden by default. - false == true

Status: VERIFIED FIXED

(Firefox Health Report Graveyard :: Client: Desktop, defect)

Description

[Ed Morley [:emorley]]

Something in this range:
https://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=8883360b1edb&tochange=5811efc11011

Caused failures of form:
https://tbpl.mozilla.org/php/getParsedLog.php?id=37570159&tree=Mozilla-Central
https://tbpl.mozilla.org/php/getParsedLog.php?id=37570604&tree=Mozilla-Central
{
TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/browser_experiments.js | Experiment tab hidden by default. - false == true - JS frame :: chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/browser_experiments.js :: testInitialState :: line 48
TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/browser_select_selection.js | Should only be listing extensions - Got experiment, expected extension
TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/test-window/browser_experiments.js | Experiment tab hidden by default. - false == true - JS frame :: chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/test-window/browser_experiments.js :: testInitialState :: line 48
}

...on nightly only mochitest-browser chrome runs (note the nightly test job appears on the pgo line due to bug 832050).

Guessing that this is another case of bug 932211 rearing its delightful head.

Comment 1

[Ed Morley [:emorley]]

That range includes:
https://hg.mozilla.org/mozilla-central/rev/0e9ff2ea5085
https://hg.mozilla.org/mozilla-central/rev/7ade80b09c73
https://hg.mozilla.org/mozilla-central/rev/d7cbb56f75e1

Comment 2

[Benjamin Smedberg]

I would guess that this has something to do with telemetry being off-by-default for on-checkin builds but on for nightlies.

Comment 3

[Gregory Szorc [:gps]]

If this is blocking anything in release land, it's OK to disable the test. I'm actively working on this test and the code behind it and I will address the problem before this feature is enabled for the Nightly audience.

Comment 4

[Legacy TBPL/Treeherder Robot]

edmorley
https://tbpl.mozilla.org/php/getParsedLog.php?id=37624474&tree=Mozilla-Central
Rev4 MacOSX Snow Leopard 10.6 mozilla-central opt test mochitest-browser-chrome on 2014-04-11 04:18:26
revision: d8c1b10c3a3d
slave: talos-r4-snow-104

TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/browser_experiments.js | Experiment tab hidden by default. - false == true - JS frame :: chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/browser_experiments.js :: testInitialState :: line 55
TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/browser_select_selection.js | Should only be listing extensions - Got experiment, expected extension
TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/test-window/browser_experiments.js | Experiment tab hidden by default. - false == true - JS frame :: chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/test-window/browser_experiments.js :: testInitialState :: line 55

Comment 5

[Legacy TBPL/Treeherder Robot]

edmorley
https://tbpl.mozilla.org/php/getParsedLog.php?id=37628182&tree=Mozilla-Central
Ubuntu VM 12.04 x64 mozilla-central pgo test mochitest-browser-chrome on 2014-04-11 05:24:18
revision: d8c1b10c3a3d
slave: tst-linux64-spot-686

TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/browser_experiments.js | Experiment tab hidden by default. - false == true - JS frame :: chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/browser_experiments.js :: testInitialState :: line 55
TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/browser_select_selection.js | Should only be listing extensions - Got experiment, expected extension
TEST-UNEXPECTED-FAIL | chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/test-window/browser_experiments.js | Experiment tab hidden by default. - false == true - JS frame :: chrome://mochitests/content/browser/toolkit/mozapps/extensions/test/browser/test-window/browser_experiments.js :: testInitialState :: line 55

Comment 6

[Benjamin Smedberg]

I believe this will be fixed by bug 997188