1563904 - Intermittent INFRA-ERROR: Failed to install geckoview_example.apk after ADBTimeoutError

Status: RESOLVED DUPLICATE of bug 1500266

(Testing :: Mozbase, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dvarga [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=255091752&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/cqfC-O0KS0yHKySSqFFr1A/runs/0/artifacts/public/logs/live_backing.log

---

13:04:32     INFO - New mozdevice with adb=adb, device=HT85R1A01491
13:04:32     INFO - adb -s HT85R1A01491 logcat -v threadtime Trace:S StrictMode:S ExchangeService:S
13:04:35     INFO - Failed to install /builds/task_1562418220/workspace/build/geckoview_example.apk on pixel2-28: ADBProcessError args: adb wait-for-device install /builds/task_1562418220/workspace/build/geckoview_example.apk, exitcode: 1, stdout: adb: failed to install /builds/task_1562418220/workspace/build/geckoview_example.apk: Performing Streamed Install
13:04:35    FATAL - INFRA-ERROR: Failed to install geckoview_example.apk
13:04:35    FATAL - Running post_fatal callback...
13:04:35    FATAL - Exiting 4
13:04:35     INFO - Killing logcat pid 491.
13:04:35     INFO - Running post-action listener: _resource_record_post_action
13:04:35     INFO - [mozharness: 2019-07-06 13:04:35.785508Z] Finished install step (failed)
13:04:35     INFO - Running post-run listener: _resource_record_post_run
13:04:35     INFO - Total resource usage - Wall time: 6s; CPU: 3.0%; Read bytes: 1490944; Write bytes: 4816896; Read time: 0; Write time: 26828
13:04:35     INFO - TinderboxPrint: CPU usage<br/>3.2%
13:04:35     INFO - TinderboxPrint: I/O read bytes / time<br/>1,490,944 / 0
13:04:35     INFO - TinderboxPrint: I/O write bytes / time<br/>4,816,896 / 26,828
13:04:35     INFO - TinderboxPrint: CPU idle<br/>22.5 (94.3%)
13:04:35     INFO - TinderboxPrint: CPU iowait<br/>0.6 (2.4%)
13:04:35     INFO - TinderboxPrint: CPU system<br/>0.3 (1.4%)
13:04:35     INFO - TinderboxPrint: CPU user<br/>0.4 (1.7%)
13:04:35     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
13:04:35     INFO - install - Wall time: 7s; CPU: 3.0%; Read bytes: 1490944; Write bytes: 4816896; Read time: 0; Write time: 26828
cleanup
+ cleanup
+ local rv=4
+ [[ -s /builds/worker/.xsession-errors ]]
+ false
+ exit 4

Comment 1

[Bob Clary [:bc] (inactive)]

(In reply to Treeherder Bug Filer from comment #0)

Filed by: dvarga [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=255091752&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/cqfC-O0KS0yHKySSqFFr1A/runs/0/artifacts/public/logs/live_backing.log

That parsed log link points to a different error on a different device

11:57:12     INFO - adb -s FA84B1A00179 logcat -v threadtime Trace:S StrictMode:S ExchangeService:S
12:02:12     INFO - Failed to install /builds/task_1562414179/workspace/build/geckoview_example.apk on pixel2-21: ADBTimeoutError args: adb wait-for-device install /builds/task_1562414179/workspace/build/geckoview_example.apk, exitcode: None, stdout: 
12:02:12    FATAL - INFRA-ERROR: Failed to install geckoview_example.apk
12:02:12    FATAL - Running post_fatal callback...
12:02:12    FATAL - Exiting 4

This is really just another ADBTimeoutError and should be tracked with the others as there is nothing specific about the test regarding this error.

Comment 2

[Intermittent Failures Robot]

11 failures in 3501 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 6
• mozilla-central: 1
• autoland: 3
• try: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 7
• android-hw-p2-8-0-arm7-api-16: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-07-01&endday=2019-07-07&tree=all

Comment 3

[Bob Clary [:bc] (inactive)]

No specific pattern in devices
2 pixel2-21
1 pixel2-60
1 pixel2-54
1 pixel2-45
1 pixel2-43
1 pixel2-33
1 pixel2-32
1 pixel2-31
1 pixel2-28
1 pixel2-26

Comment 4

[Intermittent Failures Robot]

32 failures in 4710 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 9
• mozilla-beta: 2
• mozilla-inbound: 6
• autoland: 11
• try: 4

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 22
• android-hw-p2-8-0-arm7-api-16: 9
• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-07-08&endday=2019-07-14&tree=all

Comment 5

[Bob Clary [:bc] (inactive)]

Most of these are misclassifications. I check them all and found a couple of

subprocess.CalledProcessError: Command '['/builds/task_1562949224/workspace/testing/mozproxy/host-utils-68.0a1.en-US.linux-x86_64/certutil', '-d', 'sql:/tmp/tmpUVkMxA.mozrunner/', '-L']' returned non-zero exit status 255

and lots of

INFO - Failed to install /builds/task_1563037439/workspace/build/geckoview_example.apk on <device>: ADBTimeoutError args: adb wait-for-device install /builds/task_1563037439/workspace/build/geckoview_example.apk, exitcode: None, stdout:

and

INFRA-ERROR: ADBTimeoutError Failed to install geckoview_example.apk

Comment 7

[Intermittent Failures Robot]

22 failures in 4298 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12
• try: 1
• mozilla-beta: 1
• mozilla-central: 8

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 8
• android-hw-p2-8-0-arm7-api-16: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-07-15&endday=2019-07-21&tree=all

Comment 8

[Bob Clary [:bc] (inactive)]

All but one of these were ABBTimeoutErrors. The other was an ADBProcessError. pixel2-57 had the most with 4.

Comment 9

[Intermittent Failures Robot]

1 failures in 4608 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-07-22&endday=2019-07-28&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 4439 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-07-29&endday=2019-08-04&tree=all

Comment 11

[Intermittent Failures Robot]

3 failures in 4666 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 2

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 1
• android-hw-p2-8-0-android-aarch64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-08-05&endday=2019-08-11&tree=all

Comment 12

[Intermittent Failures Robot]

1 failures in 4839 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-08-12&endday=2019-08-18&tree=all

Comment 13

[Intermittent Failures Robot]

11 failures in 5073 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 1
• mozilla-inbound: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 7
• android-hw-p2-8-0-arm7-api-16: 3
• macosx1014-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-08-19&endday=2019-08-25&tree=all

Comment 14

[Intermittent Failures Robot]

2 failures in 5047 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 1
• android-hw-p2-8-0-android-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-08-26&endday=2019-09-01&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 4408 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-09-02&endday=2019-09-08&tree=all

Comment 16

[Intermittent Failures Robot]

2 failures in 4637 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 1
• android-hw-p2-8-0-android-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-09-09&endday=2019-09-15&tree=all

Comment 17

[Intermittent Failures Robot]

4 failures in 4292 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 3

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 2
• android-hw-p2-8-0-android-aarch64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-09-30&endday=2019-10-06&tree=all

Comment 18

[Intermittent Failures Robot]

1 failures in 3801 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563904&startday=2019-10-07&endday=2019-10-13&tree=all