1527403 - Android armv7-api16 Permafail - TypeError: SimpleTest.harnessParameters is undefined at SimpleTest_setTimeoutShim@https://example.com/tests/SimpleTest/SimpleTest.js:669:9

Status: REOPENED

(Toolkit :: Password Manager, defect, P3)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: apavel [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=227966353&repo=autoland

https://queue.taskcluster.net/v1/task/MjZGOQvnSz-9kDlgAyw7zQ/runs/0/artifacts/public/logs/live_backing.log

[task 2019-02-12T18:30:11.558Z] 18:30:11 INFO - 403 INFO TEST-START | toolkit/components/passwordmgr/test/mochitest/test_autofill_highlight.html
[task 2019-02-12T18:30:31.994Z] 18:30:31 INFO - 404 INFO TEST-OK | toolkit/components/passwordmgr/test/mochitest/test_autofill_highlight.html | took 13020ms
[task 2019-02-12T18:30:31.995Z] 18:30:31 INFO - 405 INFO TEST-START | Shutdown
[task 2019-02-12T18:30:31.996Z] 18:30:31 INFO - 406 INFO Passed: 3
[task 2019-02-12T18:30:31.996Z] 18:30:31 INFO - 407 INFO Failed: 0
[task 2019-02-12T18:30:31.996Z] 18:30:31 INFO - 408 INFO Todo: 0
[task 2019-02-12T18:30:31.997Z] 18:30:31 INFO - 409 INFO Mode: non-e10s
[task 2019-02-12T18:30:31.997Z] 18:30:31 INFO - 410 INFO Slowest: 13019ms - /tests/toolkit/components/passwordmgr/test/mochitest/test_autofill_highlight.html
[task 2019-02-12T18:30:31.997Z] 18:30:31 INFO - 411 INFO SimpleTest FINISHED
[task 2019-02-12T18:32:36.852Z] 18:32:36 INFO - 412 INFO TEST-UNEXPECTED-FAIL | unknown test url | uncaught exception - TypeError: SimpleTest.harnessParameters is undefined at SimpleTest_setTimeoutShim@https://example.com/tests/SimpleTest/SimpleTest.js:669:9
[task 2019-02-12T18:32:36.852Z] 18:32:36 INFO - add_task@https://example.com/tests/SimpleTest/AddTask.js:30:7
[task 2019-02-12T18:32:36.854Z] 18:32:36 INFO - @https://example.com/tests/toolkit/components/passwordmgr/test/mochitest/test_autofill_highlight.html:38:1
[task 2019-02-12T18:32:36.854Z] 18:32:36 INFO - simpletestOnerror@https://example.com/tests/SimpleTest/SimpleTest.js:1665:13
[task 2019-02-12T18:32:39.082Z] 18:32:39 INFO - 413 INFO TEST-UNEXPECTED-FAIL | | /tests/toolkit/components/passwordmgr/test/mochitest/test_autofill_highlight.html - finished in a non-clean fashion, probably because it didn't call SimpleTest.finish()
[task 2019-02-12T18:32:39.082Z] 18:32:39 INFO - {u'loaded_test_url': u'/tests/toolkit/components/passwordmgr/test/mochitest/test_autofill_highlight.html'}
[task 2019-02-12T18:32:39.083Z] 18:32:39 INFO - 414 INFO TEST-UNEXPECTED-ERROR | | Finished in 15028ms
[task 2019-02-12T18:32:39.083Z] 18:32:39 INFO - {u'runtime': 15028}
[task 2019-02-12T18:32:39.083Z] 18:32:39 INFO - TEST-INFO
[task 2019-02-12T18:32:39.793Z] 18:32:39 INFO - 415 INFO SimpleTest START

Comment 1

[Andreea Pavel [:apavel]]

This got backed out here: https://hg.mozilla.org/integration/autoland/rev/34f33ae5913ef665fb56884e32ed75a7d4d5e680

Comment 2

[Intermittent Failures Robot]

5 failures in 2832 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5

Platform breakdown:

• android-em-4-3-armv7-api16: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1527403&startday=2019-02-11&endday=2019-02-17&tree=all

Comment 3

[Raul Gurzau (:RaulG)]

Reoccurring here: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=233674026&repo=autoland&lineNumber=2380

[task 2019-03-13T19:20:55.101Z] 19:20:55 INFO - remoteautomation.py | Application ran for: 0:07:43.973777
[task 2019-03-13T19:20:59.278Z] 19:20:59 INFO - adb Ignoring attempt to chmod external storage
[task 2019-03-13T19:20:59.278Z] 19:20:59 INFO - runtests.py | Running with scheme: https
[task 2019-03-13T19:20:59.278Z] 19:20:59 INFO - runtests.py | Running with e10s: False
[task 2019-03-13T19:20:59.279Z] 19:20:59 INFO - runtests.py | Running with serviceworker_e10s: False
[task 2019-03-13T19:20:59.279Z] 19:20:59 INFO - runtests.py | Running with socketprocess_e10s: False
[task 2019-03-13T19:20:59.279Z] 19:20:59 INFO - runtests.py | Running tests: start.
[task 2019-03-13T19:20:59.600Z] 19:20:59 INFO - remoteautomation.py | runApp deleted /sdcard/tests/logs/mochitest.log
[task 2019-03-13T19:20:59.917Z] 19:20:59 INFO - adb launch_application: am start -W -n org.mozilla.fennec_aurora/org.mozilla.gecko.BrowserApp -a android.intent.action.VIEW --es env9 MOZ_UPLOAD_DIR=/sdcard/tests/mozlog --es env8 R_LOG_DESTINATION=stderr --es args "-no-remote -profile /sdcard/tests/profile//" --es env3 DISABLE_UNSAFE_CPOW_WARNINGS=1 --es env2 R_LOG_VERBOSE=1 --es env1 XPCOM_DEBUG_BREAK=stack --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_LOG_FILE=/sdcard/tests/mozlog/moz.log --es env6 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env5 MOZ_IN_AUTOMATION=1 --es env4 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env12 MOZ_HIDE_RESULTS_TABLE=1 --es env11 R_LOG_LEVEL=6 --es env10 MOZ_CRASHREPORTER_NO_REPORT=1 -d "https://example.com:443/tests?autorun=1&closeWhenDone=1&logFile=%2Fsdcard%2Ftests%2Flogs%2Fmochitest.log&fileLevel=INFO&consoleLevel=INFO&hideResultsTable=1&manifestFile=tests.json&dumpOutputDirectory=%2Fsdcard%2Ftests"
[task 2019-03-13T19:21:10.253Z] 19:21:10 INFO - remoteautomation.py | Application pid: 3507
[task 2019-03-13T19:22:08.417Z] 19:22:08 INFO - 402 INFO SimpleTest START
[task 2019-03-13T19:22:08.417Z] 19:22:08 INFO - 403 INFO TEST-START | toolkit/components/passwordmgr/test/mochitest/test_one_doorhanger_per_un_pw.html
[task 2019-03-13T19:22:18.636Z] 19:22:18 INFO - 404 INFO TEST-OK | toolkit/components/passwordmgr/test/mochitest/test_one_doorhanger_per_un_pw.html | took 9230ms
[task 2019-03-13T19:22:18.636Z] 19:22:18 INFO - 405 INFO TEST-START | Shutdown
[task 2019-03-13T19:22:18.636Z] 19:22:18 INFO - 406 INFO Passed: 6
[task 2019-03-13T19:22:18.637Z] 19:22:18 INFO - 407 INFO Failed: 0
[task 2019-03-13T19:22:18.637Z] 19:22:18 INFO - 408 INFO Todo: 1
[task 2019-03-13T19:22:18.638Z] 19:22:18 INFO - 409 INFO Mode: non-e10s
[task 2019-03-13T19:22:18.639Z] 19:22:18 INFO - 410 INFO Slowest: 9214ms - /tests/toolkit/components/passwordmgr/test/mochitest/test_one_doorhanger_per_un_pw.html
[task 2019-03-13T19:22:18.639Z] 19:22:18 INFO - 411 INFO SimpleTest FINISHED
[task 2019-03-13T19:24:19.723Z] 19:24:19 INFO - 412 INFO TEST-PASS | unknown test url | A valid string reason is expected
[task 2019-03-13T19:24:19.723Z] 19:24:19 INFO - 413 INFO TEST-PASS | unknown test url | Reason cannot be empty
[task 2019-03-13T19:24:19.724Z] 19:24:19 INFO - 414 INFO TEST-UNEXPECTED-FAIL | unknown test url | uncaught exception - TypeError: SimpleTest.harnessParameters is undefined at SimpleTest_setTimeoutShim@https://example.com/tests/SimpleTest/SimpleTest.js:669:17
[task 2019-03-13T19:24:19.724Z] 19:24:19 INFO - add_task@https://example.com/tests/SimpleTest/AddTask.js:30:7
[task 2019-03-13T19:24:19.725Z] 19:24:19 INFO - @https://example.com/tests/toolkit/components/passwordmgr/test/mochitest/test_one_doorhanger_per_un_pw.html:44:3
[task 2019-03-13T19:24:19.725Z] 19:24:19 INFO - simpletestOnerror@https://example.com/tests/SimpleTest/SimpleTest.js:1665:24
[task 2019-03-13T19:24:22.069Z] 19:24:22 INFO - 415 INFO TEST-UNEXPECTED-FAIL | | /tests/toolkit/components/passwordmgr/test/mochitest/test_one_doorhanger_per_un_pw.html - finished in a non-clean fashion, probably because it didn't call SimpleTest.finish()
[task 2019-03-13T19:24:22.070Z] 19:24:22 INFO - {u'loaded_test_url': u'/tests/toolkit/components/passwordmgr/test/mochitest/test_one_doorhanger_per_un_pw.html'}
[task 2019-03-13T19:24:22.070Z] 19:24:22 INFO - 416 INFO TEST-UNEXPECTED-ERROR | | Finished in 18841ms
[task 2019-03-13T19:24:22.070Z] 19:24:22 INFO - {u'runtime': 18841}
[task 2019-03-13T19:24:22.070Z] 19:24:22 INFO - TEST-INFO

Comment 4

[Intermittent Failures Robot]

35 failures in 507 pushes (0.069 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 25
• mozilla-central: 5
• mozilla-inbound: 5

Platform breakdown:

• android-em-4-3-armv7-api16: 35

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1527403&startday=2019-03-13&endday=2019-03-13&tree=all

Comment 5

[Andreea Pavel [:apavel]]

Failure rate seems to have increased with the landing of bug Bug 1529946, :prathiksha can you take a look?

https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=android%2C4.3%2Capi16%2B%2Copt%2Cmochitests%2Ctest-android-em-4.3-arm7-api-16%2Fopt-mochitest-24%2Cm%2824%29&tochange=cbb4a76be84b534152b242877555c60fdcb3fa07&group_state=expanded&fromchange=9c7c3ca1638713bec7857c25eafa4b2099594d29&selectedJob=233674026

Comment 6

[Intermittent Failures Robot]

110 failures in 524 pushes (0.21 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 88
• mozilla-inbound: 13
• mozilla-central: 6
• try: 3

Platform breakdown:

• android-em-4-3-armv7-api16: 109
• android-hw-p2-8-0-android-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1527403&startday=2019-03-14&endday=2019-03-14&tree=all

Comment 7

[Matthew N. [:MattN]]

This will be fixed by disabling test_one_doorhanger_per_un_pw.html on Android in bug 1535222

Comment 8

[Arthur Iakab [arthur_iakab]]

This is perma failing https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=android%2C4.3%2Capi16%2B%2Copt%2Cmochitests%2Ctest-android-em-4.3-arm7-api-16%2Fopt-mochitest-24%2Cm%2824%29&fromchange=a09b3ceb8f7258c0a7d0d2efa95b505d66460f3c&selectedJob=234086676

Comment 9

[Intermittent Failures Robot]

25 failures in 436 pushes (0.057 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 8
• mozilla-central: 3
• mozilla-inbound: 10
• try: 3
• mozilla-beta: 1

Platform breakdown:

• android-em-4-3-armv7-api16: 25

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1527403&startday=2019-03-15&endday=2019-03-15&tree=all

Comment 10

[Andreea Pavel [:apavel]]

Thanks Matthew, confirming that this is fixed after bug 1535222 landed.

Comment 11

[Intermittent Failures Robot]

170 failures in 2771 pushes (0.061 failures/push) were associated with this bug in the last 7 days.

This is the #12 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 121
• mozilla-inbound: 28
• mozilla-central: 14
• try: 6
• mozilla-beta: 1

Platform breakdown:

• android-em-4-3-armv7-api16: 169
• android-hw-p2-8-0-android-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1527403&startday=2019-03-11&endday=2019-03-17&tree=all

Comment 12

[Matthew N. [:MattN]]

With most new mochitest-plain we enable on Android it ends up failing with this issue now. Bug 936026 was another victim.

For now we're just disabling the new tests on Android.

Comment 13

[Intermittent Failures Robot]

9 failures in 2561 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-inbound: 1
• mozilla-central: 5

Platform breakdown:

• android-em-4-3-armv7-api16: 1
• android-em-4-3-armv7-api16-pgo: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1527403&startday=2019-03-18&endday=2019-03-24&tree=all