1061390 - Intermittent failing test, TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings common tests language description on the root panel is translated

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Gaia::Settings, defect)

Description

[Evan Tseng [:evanxd]]

The error log:
18:03:41     INFO -    3) check root panel settings common tests language description on the root panel is translated:
18:03:41     INFO -    TypeError: Cannot call method 'scriptWith' of null
18:03:41     INFO -        at Object.MarionetteHelper.tapSelectOption (/builds/slave/test/gaia/node_modules/marionette-helper/index.js:287:20)
18:03:41     INFO -        at Object.Base.tapSelectOption (/builds/slave/test/gaia/apps/settings/test/marionette/app/base.js:68:24)
18:03:41     INFO -        at Object.currentLanguage (/builds/slave/test/gaia/apps/settings/test/marionette/app/regions/language.js:101:12)
18:03:41     INFO -        at Object.currentLanguage (/builds/slave/test/gaia/apps/settings/test/marionette/app/app.js:201:35)
18:03:41     INFO -        at Context.<anonymous> (/builds/slave/test/gaia/apps/settings/test/marionette/tests/root_settings_test.js:59:35)
18:03:41     INFO -        at callFn (/builds/slave/test/gaia/node_modules/mocha/lib/runnable.js:223:21)
18:03:41     INFO -        at Test.Runnable.run (/builds/slave/test/gaia/node_modules/mocha/lib/runnable.js:216:7)
18:03:41     INFO -        at Runner.runTest (/builds/slave/test/gaia/node_modules/mocha/lib/runner.js:373:10)
18:03:41     INFO -        at /builds/slave/test/gaia/node_modules/mocha/lib/runner.js:451:12
18:03:41     INFO -        at next (/builds/slave/test/gaia/node_modules/mocha/lib/runner.js:298:14)
18:03:41     INFO -        at /builds/slave/test/gaia/node_modules/mocha/lib/runner.js:308:7
18:03:41     INFO -        at next (/builds/slave/test/gaia/node_modules/mocha/lib/runner.js:246:23)
18:03:41     INFO -        at /builds/slave/test/gaia/node_modules/mocha/lib/runner.js:270:7
18:03:41     INFO -        at done (/builds/slave/test/gaia/node_modules/mocha/lib/runnable.js:185:5)
18:03:41     INFO -        at callFn (/builds/slave/test/gaia/node_modules/mocha/lib/runnable.js:228:7)
18:03:41     INFO -        at Hook.Runnable.run (/builds/slave/test/gaia/node_modules/mocha/lib/runnable.js:216:7)
18:03:41     INFO -        at next (/builds/slave/test/gaia/node_modules/mocha/lib/runner.js:258:10)
18:03:41     INFO -        at Object._onImmediate (/builds/slave/test/gaia/node_modules/mocha/lib/runner.js:275:5)
18:03:41     INFO -        at processImmediate [as _immediateCallback] (timers.js:330:15)

* https://tbpl.mozilla.org/php/getParsedLog.php?id=47189761&tree=Gaia-Try#error2
* https://tbpl.mozilla.org/php/getParsedLog.php?id=47188421&tree=Gaia-Try#error0
* https://tbpl.mozilla.org/php/getParsedLog.php?id=47187573&tree=Gaia-Try#error0

Comment 1

[Evan Tseng [:evanxd]]

Attachment: Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/23599

Disable the test.

Comment 2

[Evan Tseng [:evanxd]]

Hi Arthur,
It is the intermittent failing test.
If you need help, please let me know.

Comment 3

[Legacy TBPL/Treeherder Robot]

seth
https://tbpl.mozilla.org/php/getParsedLog.php?id=50828769&tree=Try
b2g_ubuntu64_vm try opt test gaia-js-integration-2 on 2014-10-22 15:33:38
revision: be5f38870303
slave: tst-linux64-spot-781

TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings common tests "before each" hook
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/composer_test.js | Messages Composer Messages Composer Test Suite Message char counter and MMS label
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/new_activity_test.js | Messages as "new" activity target Send new message Using activity.data.body and activity.data.number Correctly initializes message content and recipients
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should close activity if in Composer panel
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should close activity if in Thread panel
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should return to Thread panel if in Report panel
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should return to Thread panel if in Participants panel
AssertionError: XSS should not be performed: expected false to be true
make: *** [test-integration-test] Error 7
Return code: 2
Tests exited with return code 2: harness failures
# TBPL FAILURE #

Comment 4

[Legacy TBPL/Treeherder Robot]

seth
https://tbpl.mozilla.org/php/getParsedLog.php?id=50829329&tree=Try
b2g_ubuntu64_vm try opt test gaia-js-integration-2 on 2014-10-22 15:33:39
revision: b58b68e51a13
slave: tst-linux64-spot-1061

TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings common tests "before each" hook
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/composer_test.js | Messages Composer Messages Composer Test Suite Message char counter and MMS label
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/new_activity_test.js | Messages as "new" activity target Send new message Using activity.data.body and activity.data.number Correctly initializes message content and recipients
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should close activity if in Composer panel
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should close activity if in Thread panel
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should return to Thread panel if in Report panel
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should return to Thread panel if in Participants panel
AssertionError: XSS should not be performed: expected false to be true
make: *** [test-integration-test] Error 7
Return code: 2
Tests exited with return code 2: harness failures
# TBPL FAILURE #

Comment 5

[Legacy TBPL/Treeherder Robot]

seth
https://tbpl.mozilla.org/php/getParsedLog.php?id=50837104&tree=Try
b2g_ubuntu64_vm try opt test gaia-js-integration-2 on 2014-10-22 17:21:08
revision: 60a7ae2d80e2
slave: tst-linux64-spot-1243

TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings common tests "before each" hook
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/composer_test.js | Messages Composer Messages Composer Test Suite Message char counter and MMS label
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/new_activity_test.js | Messages as "new" activity target Send new message Using activity.data.body and activity.data.number Correctly initializes message content and recipients
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should close activity if in Composer panel
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should close activity if in Thread panel
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should return to Thread panel if in Report panel
TEST-UNEXPECTED-FAIL | /builds/slave/test/gaia/apps/sms/test/marionette/share_activity_test.js | Messages as share target Share via Messages Activity close button Should return to Thread panel if in Participants panel
AssertionError: XSS should not be performed: expected false to be true
make: *** [test-integration-test] Error 7
Return code: 2
Tests exited with return code 2: harness failures
# TBPL FAILURE #

Comment 6

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2014-11-19T14:37:36
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=mozilla-inbound&job_id=4048762
repository: mozilla-inbound
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-822
buildname: b2g_ubuntu64_vm mozilla-inbound opt test gaia-js-integration-2
revision: fd343a8b5cfe

make[1]: *** [git-gaia-node-modules] Error 128
make: *** [node_modules] Error 2
Return code: 2
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "after each" hook
make: *** [test-integration-test] Error 2
Return code: 2
Tests exited with return code 2: harness failures
# TBPL FAILURE #

Comment 7

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2014-11-20T04:47:03
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=mozilla-inbound&job_id=4072959
repository: mozilla-inbound
who: tomcat[at]mozilla[dot]com
machine: tst-linux64-spot-580
buildname: b2g_ubuntu64_vm mozilla-inbound opt test gaia-js-integration-2
revision: 1bee60dc14ec

TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "after each" hook
make: *** [test-integration-test] Error 2
Return code: 2
Tests exited with return code 2: harness failures
# TBPL FAILURE #

Comment 8

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2014-11-27T01:32:08
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=mozilla-inbound&job_id=4255204
repository: mozilla-inbound
who: tomcat[at]mozilla[dot]com
machine: tst-linux64-spot-1243
buildname: b2g_ubuntu64_vm mozilla-inbound opt test gaia-js-integration-2
revision: 1e6ed5eab5e1

TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "after each" hook
make: *** [test-integration-test] Error 2
Return code: 2
Tests exited with return code 2: harness failures
# TBPL FAILURE #

Comment 9

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2014-12-09T07:50:09
log: https://treeherder.mozilla.org/ui/logviewer.html#?repo=mozilla-inbound&job_id=4461471
repository: mozilla-inbound
who: tomcat[at]mozilla[dot]com
machine: tst-linux64-spot-806
buildname: b2g_ubuntu64_vm mozilla-inbound opt test gaia-js-integration-2
revision: dc459e217045

TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "after each" hook
TypeError: Cannot call method 'send' of undefined
TypeError: Cannot call method 'send' of undefined
make: *** [test-integration-test] Error 2
Return code: 2
Tests exited with return code 2: harness failures
# TBPL FAILURE #

Comment 10

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2015-01-09T18:57:58
log: https://treeherder.mozilla.org/logviewer.html#?repo=b2g-inbound&job_id=1137719
repository: b2g-inbound
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-758
buildname: b2g_ubuntu64_vm b2g-inbound opt test gaia-js-integration-2
revision: edf081cb3abf

TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "after each" hook
make: *** [test-integration-test] Error 2
Return code: 2
Tests exited with return code 2: harness failures
# TBPL FAILURE #

Comment 11

[Legacy TBPL/Treeherder Robot]

submit_timestamp: 2015-01-15T17:51:17
log: https://treeherder.mozilla.org/logviewer.html#?repo=b2g-inbound&job_id=1171726
repository: b2g-inbound
who: gwagner[at]mozilla[dot]com
machine: tst-linux64-spot-816
buildname: b2g_ubuntu64_vm b2g-inbound opt test gaia-js-integration-4
revision: 1efa20405cf6

TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/language_settings_test.js | manipulate language settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/language_settings_test.js | manipulate language settings "after each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings "after each" hook
make: *** [test-integration-test] Error 4
Return code: 2
Tests exited with return code 2: harness failures
# TBPL FAILURE #

Comment 12

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=gaia&job_id=869216
repository: gaia
start_time: 2015-04-17T04:55:20
who: fbraun[at]mozilla[dot]com
machine: unknown
revision: f7a60a283aab208de8f740d0270b6c7a6c9a3180

TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/language_settings_test.js | manipulate language settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/media_storage_settings_test.js | manipulate media storage settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/notifications_settings_test.js | manipulate notifications settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings common tests "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings sim related tests single sim tests "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/root_settings_test.js | check root panel settings sim related tests multiple sim tests "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/screen_lock_settings_test.js | manipulate screenLock settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/sound_settings_test.js | manipulate sound settings "before each" hook
TEST-UNEXPECTED-FAIL | apps/settings/test/marionette/tests/support_settings_test.js | manipulate support settings check support without SIM custom "before each" hook

Comment 13

[Arthur Chen [:arthurcc][inactive after 6/30]]

Attachment: link to https://github.com/mozilla-b2g/gaia/pull/30591

Comment 14

[Arthur Chen [:arthurcc][inactive after 6/30]]

Comment on attachment 8622413 [details]
link to https://github.com/mozilla-b2g/gaia/pull/30591

EJ, could you help review this patch? It enables the disabled test and uses `waitFor` to make it more robust.

Comment 15

[EJ Chen [:eragonj][:小龍哥][Contributor mode on](inactive)]

Comment on attachment 8622413 [details]
link to https://github.com/mozilla-b2g/gaia/pull/30591

Thanks Arthur, let's re-enable this test.

Comment 16

[Arthur Chen [:arthurcc][inactive after 6/30]]

Thanks, EJ!

master: 4ad345e10b1d7901427a9a5f3aed651b311b7091

Comment 17

[Intermittent Failures Robot]

5 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* b2g-inbound: 3
* mozilla-inbound: 1
* mozilla-central: 1

Platform breakdown:
* mulet-linux64: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1061390&startday=2015-11-02&endday=2015-11-08&tree=all