1161150 - Intermittent Android 4.3 PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?) during testFilePicker

Status: RESOLVED FIXED

(Firefox for Android Graveyard :: General, defect)

Description

[Ryan VanderMeulen [:RyanVM]]

07:51:42 INFO - SimpleTest START
07:51:42 INFO - TEST-START | testFilePicker
07:51:42 INFO - INFO | automation.py | Application ran for: 0:05:45.341078
07:51:42 INFO - INFO | zombiecheck | Reading PID log: /tmp/tmpck5edepidlog
07:51:42 INFO - Contents of /data/anr/traces.txt:
07:51:42 INFO -
07:51:42 INFO -
07:51:42 INFO - Stopping web server
07:51:42 INFO - Stopping web socket server
07:51:42 INFO - Stopping ssltunnel
07:51:42 INFO - WARNING | leakcheck | refcount logging is off, so leaks can't be detected!
07:51:42 INFO - runtests.py | Running tests: end.
07:51:42 WARNING - PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 1

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9535138
repository: mozilla-inbound
start_time: 2015-05-04T06:53:10
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-744
buildname: Android 4.3 armv7 API 11+ mozilla-inbound opt test robocop-3
revision: 0e95b93afba0

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 2

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2930048
repository: fx-team
start_time: 2015-05-04T14:55:14
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-2092
buildname: Android 4.3 armv7 API 11+ fx-team opt test robocop-3
revision: 45a614729d09

Automation Error: No crash directory (/sdcard/tests/profile/minidumps/) found on remote device
PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 3

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2961659
repository: fx-team
start_time: 2015-05-06T11:54:46
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-1545
buildname: Android armv7 API 9 fx-team opt test robocop-2
revision: 55d489bb8ad5

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 4

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2968702
repository: fx-team
start_time: 2015-05-07T02:21:23
who: tomcat[at]mozilla[dot]com
machine: tst-linux64-spot-2055
buildname: Android armv7 API 9 fx-team opt test robocop-2
revision: e05936099653

PROCESS-CRASH | testInputUrlBar | application crashed [@ libui.so + 0x1befe]
PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 5

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=1449583
repository: mozilla-central
start_time: 2015-05-07T07:57:02
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-1851
buildname: Android armv7 API 9 mozilla-central opt test robocop-2
revision: 6c8b6e1d328f

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 6

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9646780
repository: mozilla-inbound
start_time: 2015-05-07T08:39:18
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-1741
buildname: Android armv7 API 9 mozilla-inbound opt test robocop-2
revision: 34fae3ffbf62

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 7

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=1449679
repository: mozilla-central
start_time: 2015-05-07T08:04:58
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-557
buildname: Android armv7 API 9 mozilla-central opt test robocop-2
revision: 403e3c2380b5

PROCESS-CRASH | testInputUrlBar | application crashed [@ libc.so + 0x15ec8]
PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 8

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=b2g-inbound&job_id=1869206
repository: b2g-inbound
start_time: 2015-05-07T08:41:52
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-232
buildname: Android armv7 API 9 b2g-inbound opt test robocop-2
revision: e9f75be97c2d

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 9

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9654292
repository: mozilla-inbound
start_time: 2015-05-07T08:49:10
who: arai_a[at]mac[dot]com
machine: tst-linux64-spot-1043
buildname: Android armv7 API 9 mozilla-inbound opt test robocop-2
revision: f075bcb8c60b

PROCESS-CRASH | testInputUrlBar | application crashed [@ 0x0]
PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 10

[Geoff Brown [:gbrown]]

Unlike comments 1 and 2, comments 3 - 9 are crashes in testInputUrlBar, on Android 2.3.

Comment 11

[Geoff Brown [:gbrown]]

I suspect a regression from bug 1137483.

Comment 12

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9651121
repository: mozilla-inbound
start_time: 2015-05-07T09:16:41
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-926
buildname: Android armv7 API 9 mozilla-inbound opt test robocop-2
revision: d00a52f922ed

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 13

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

wrt testInputUrlBar, it seems we always fail after [1]:

 assertUrlBarText(mStringHelper.ABOUT_HOME_URL);

It seems just after this we drag the home pager to lose focus from the url bar, click the url bar, and enter some text; we seem to crash because the application does not respond to our input events.

If we're always failing on 2.3, this is an issue around slowness - either race condition or doing too much at the same time. Bug 1137483 added some additional layout functionality - perhaps that is making the emulator just slow enough to cause these issues.

Notably, Gecko is probably still loading in the background.

Some proposed fixes:
  * Wait a bit longer before performing the actions after goBack
  * Wait for Gecko:Ready

[1]: https://mxr.mozilla.org/mozilla-central/source/mobile/android/tests/browser/robocop/testInputUrlBar.java?rev=3dae1f0d8b0b#100

Comment 14

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

(In reply to Michael Comella (:mcomella) from comment #13)
>   * Wait for Gecko:Ready

Nevermind - we already do this.

Comment 15

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Before the failure, we also see:

10:27:11     INFO -  05-07 09:24:40.246 I/GeckoConsole(  488): 1431015880250	Toolkit.GMP	WARN	GMPInstallManager.parseResponseXML got node name: html, expected: updates
10:27:11     INFO -  05-07 09:24:40.306 E/GeckoConsole(  488): [JavaScript Error: "1431015880274	Toolkit.GMP	ERROR	GMPWrapper(gmp-gmpopenh264) findUpdates() - updateTask for gmp-gmpopenh264 threw: {"target":{},"message":"got node name: html, expected: updates"}" {file: "resource://gre/modules/Log.jsm" line: 749}]
10:27:11     INFO -  05-07 09:25:05.115 W/WindowManager(   64): Input event injection timed out.
10:27:11     INFO -  05-07 09:25:10.135 I/InputDispatcher(   64): Application is not responding: AppWindowToken{4068b9b8 token=HistoryRecord{405f1230 

Going to see if I can see this JS error locally.

Comment 16

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Before the failure, we also see:

09:04:08     INFO -  05-07 08:04:18.358 D/Telemetry(  490): StartUISession: frecency.1

^ This means the swipe event happens as expected, and we manage to click the url bar again. We type some content and the browser search screen opens. That means we're either failing inside sendKeys or getUrlBarText [1].

09:04:08     INFO -  05-07 08:04:19.808 D/GeckoLayerClient(  490): Window-size changed to (1024,572)

^ Not sure why this is happening though notably liuche mentioned the new search bar hides under the keyboard on 2.3, even though we fixed it on other versions such that this does not happen. This probably means the window is getting resized (when it shouldn't) when BrowserSearch is shown.

We also add a window background only on the BrowserSearch screen - perhaps this overdraw is adding too much extra overhead to 2.3?

[1]: https://mxr.mozilla.org/mozilla-central/source/mobile/android/tests/browser/robocop/testInputUrlBar.java?rev=3dae1f0d8b0b#112

Comment 17

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9655778
repository: mozilla-inbound
start_time: 2015-05-07T10:29:03
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-1843
buildname: Android armv7 API 9 mozilla-inbound opt test robocop-2
revision: fa9d94918e12

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 18

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9661356
repository: mozilla-inbound
start_time: 2015-05-07T10:12:17
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-682
buildname: Android armv7 API 9 mozilla-inbound opt test robocop-2
revision: 93eded78def9

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 19

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2975560
repository: fx-team
start_time: 2015-05-07T10:20:31
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-1230
buildname: Android armv7 API 9 fx-team opt test robocop-2
revision: 6b09f09f41e3

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 20

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=9658114
repository: mozilla-inbound
start_time: 2015-05-07T10:46:23
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-325
buildname: Android armv7 API 9 mozilla-inbound opt test robocop-2
revision: b4ad8eababf5

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 21

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=d85ec0683cb0

Comment 22

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

I thought fixing bug 1159360 might fix the issues here. After tracking that down (in bug 1159360), I made some conclusions in bug 1159360 comment 6. The try push in comment 21 makes the same backout as in the other comment. Note that this backout breaks things and is not a final solution.

Comment 23

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=b2g-inbound&job_id=1872511
repository: b2g-inbound
start_time: 2015-05-07T16:43:04
who: aus[at]mozilla[dot]com
machine: tst-linux64-spot-1744
buildname: Android armv7 API 9 b2g-inbound opt test robocop-2
revision: d8d74976aa49

PROCESS-CRASH | testInputUrlBar | application crashed [@ 0x0]
PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 24

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=try&job_id=7331898
repository: try
start_time: 2015-05-07T18:33:51
who: ehsan[dot]akhgari[at]gmail[dot]com
machine: tst-linux64-spot-082
buildname: Android armv7 API 9 try opt test robocop-2
revision: bed5e448d5af

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 25

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=try&job_id=7337350
repository: try
start_time: 2015-05-07T20:06:24
who: ehsan[dot]akhgari[at]gmail[dot]com
machine: tst-linux64-spot-1674
buildname: Android armv7 API 9 try opt test robocop-2
revision: bed5e448d5af

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 26

[Michael Comella (:mcomella) [NI reported issues only: ex-Mozilla]]

Fixed by the backout of bug 1137483 comment 44.

Comment 27

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=b2g-inbound&job_id=1966698
repository: b2g-inbound
start_time: 2015-05-20T00:36:47
who: tomcat[at]mozilla[dot]com
machine: tst-linux64-spot-283
buildname: Android 4.3 armv7 API 11+ b2g-inbound opt test robocop-4
revision: 5c0d1976af28

Automation Error: No crash directory (/sdcard/tests/profile/minidumps/) found on remote device
PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)

Comment 28

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=10039812
repository: mozilla-inbound
start_time: 2015-05-21T05:32:02
who: tomcat[at]mozilla[dot]com
machine: tst-linux64-spot-1086
buildname: Android 4.3 armv7 API 11+ mozilla-inbound opt test robocop-4
revision: dffde8b2633a

PROCESS-CRASH | Automation Error: Missing end of test marker (process crashed?)