1558006 - Intermittent Tier 2 Android raptor-main Critical: TEST-UNEXPECTED-FAIL: test 'raptor-tp6m-youtube-watch-geckoview-cold' timed out loading test page: https://www.youtube.com/watch?v=COU5T-Wafa4 pending metrics: fcp, fnb paint, dcf, load time

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=250792538&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/NRZZ4IGzTR-4pQfN-ZIV8w/runs/1/artifacts/public/logs/live_backing.log

---

09:30:37 INFO - raptor-output Info: combining results from browser cycle 3 for raptor-tp6m-youtube-watch-geckoview-cold
09:30:37 INFO - raptor-output Info: adding replicates for dcf
09:30:37 INFO - raptor-output Info: adding replicates for fcp
09:30:37 INFO - raptor-output Info: adding replicates for fnbpaint
09:30:37 INFO - raptor-output Info: adding replicates for loadtime
09:30:37 INFO - raptor-output Info: screen captures can be found locally at: /builds/task_1560071402/workspace/build/screenshots.html
09:30:37 INFO - raptor-output Info: PERFHERDER_DATA: {"framework": {"name": "raptor"}, "suites": [{"extraOptions": [], "name": "raptor-tp6m-wikipedia-geckoview-cold", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 849.51, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 757, "replicates": [827, 756, 757, 767, 730, 766, 718, 668, 770, 741, 720, 792, 790, 736, 771], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 857, "shouldAlert": true, "replicates": [893, 767, 860, 876, 836, 879, 772, 759, 857, 805, 826, 907, 894, 827, 874], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 695, "replicates": [721, 609, 695, 706, 677, 706, 611, 596, 696, 640, 664, 729, 726, 668, 709], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1155, "shouldAlert": true, "replicates": [1152, 1210, 1015, 1153, 1043, 1003, 1305, 1340, 1137, 1241, 1149, 1210, 1169, 1155, 1257], "unit": "ms"}], "type": "pageload", "unit": "ms"}, {"extraOptions": [], "name": "raptor-tp6m-youtube-watch-geckoview-cold", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 750.84, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 820, "replicates": [780, 1504, 820], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 710, "shouldAlert": true, "replicates": [753, 710, 672], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 306, "replicates": [325, 306, 267], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1782, "shouldAlert": true, "replicates": [2006, 1782, 1734], "unit": "ms"}], "type": "pageload", "unit": "ms"}]}
09:30:37 INFO - raptor-output Info: results can also be found locally at: /builds/task_1560071402/workspace/build/raptor.json
09:30:37 INFO - raptor-main Info: removing test folder for raptor: /sdcard/raptor
09:30:37 INFO - adb shell_output: adb -s ZY322HN78D wait-for-device shell rm -r /sdcard/raptor; echo adb_returncode=$?, timeout: None, root: False, timedout: None, exitcode: 0, output:
09:30:37 INFO - raptor-control-server Info: shutting down control server
09:30:37 INFO - raptor-main Info: finished
09:30:37 ERROR - raptor-main Critical: TEST-UNEXPECTED-FAIL: test 'raptor-tp6m-youtube-watch-geckoview-cold' timed out loading test page: https://www.youtube.com/watch?v=COU5T-Wafa4 pending metrics: fcp, fnb paint, dcf, load time
09:30:37 ERROR - Return code: 1
09:30:37 WARNING - setting return code to 1
09:30:37 INFO - Killing logcat pid 499.
09:30:37 INFO - Validating PERFHERDER_DATA against /builds/task_1560071402/workspace/mozharness/external_tools/performance-artifact-schema.json
09:30:37 INFO - copying raptor results to upload dir:
09:30:37 INFO - /builds/task_1560071402/workspace/build/blobber_upload_dir/perfherder-data.json
09:30:37 INFO - copying raptor results from /builds/task_1560071402/workspace/build/raptor.json to /builds/task_1560071402/workspace/build/blobber_upload_dir/perfherder-data.json
09:30:37 INFO - /builds/task_1560071402/workspace/build/blobber_upload_dir/screenshots.html
09:30:37 INFO - copying raptor results from /builds/task_1560071402/workspace/build/screenshots.html to /builds/task_1560071402/workspace/build/blobber_upload_dir/screenshots.html
09:30:37 INFO - Running post-action listener: _package_coverage_data
09:30:37 INFO - Running post-action listener: _resource_record_post_action
09:30:37 INFO - Running post-action listener: process_java_coverage_data
09:30:37 INFO - Running post-action listener: stop_device

Comment 1

[Intermittent Failures Robot]

1 failures in 5197 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1558006&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 2

[Intermittent Failures Robot]

3 failures in 4753 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1
• mozilla-central: 1
• autoland: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 2
• android-hw-p2-8-0-android-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1558006&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 2581 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1558006&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 4409 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1558006&startday=2019-06-24&endday=2019-06-30&tree=all

Comment 5

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 6

[Cristina Coroiu [:ccoroiu]]

Recent failure log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=266437104&repo=autoland&lineNumber=1874

[task 2019-09-13T01:43:01.512Z] 01:43:01 INFO - raptor-output Info: combining results from browser cycle 1 for raptor-tp6m-youtube-watch-geckoview-cold
[task 2019-09-13T01:43:01.512Z] 01:43:01 INFO - raptor-output Info: created new combined result with intial cycle replicates
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: combining results from browser cycle 2 for raptor-tp6m-youtube-watch-geckoview-cold
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: adding replicates for dcf
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: adding replicates for fcp
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: adding replicates for fnbpaint
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: adding replicates for loadtime
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: combining results from browser cycle 3 for raptor-tp6m-youtube-watch-geckoview-cold
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: adding replicates for dcf
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: adding replicates for fcp
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: adding replicates for fnbpaint
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: adding replicates for loadtime
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: screen captures can be found locally at: /builds/task_1568334989/workspace/build/screenshots.html
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: PERFHERDER_DATA: {"framework": {"name": "raptor"}, "suites": [{"extraOptions": [], "name": "raptor-tp6m-youtube-watch-geckoview-cold", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 594.94, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 555, "replicates": [666, 538, 555], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 710, "shouldAlert": true, "replicates": [691, 940, 710], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 245, "replicates": [243, 252, 245], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1296, "shouldAlert": true, "replicates": [1296, 1228, 1437], "unit": "ms"}], "type": "pageload", "unit": "ms"}]}
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-output Info: results can also be found locally at: /builds/task_1568334989/workspace/build/raptor.json
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-results-handler Info: Validating PERFHERDER_DATA against /builds/task_1568334989/workspace/mozharness/external_tools/performance-artifact-schema.json
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-main Info: removing test folder for raptor: /sdcard/raptor
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - adb shell_output: adb -s HT7BH1A05438 wait-for-device shell sync, timeout: None, root: False, timedout: None, exitcode: 0, output:
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - adb shell_output: adb -s HT7BH1A05438 wait-for-device shell rm -r /sdcard/raptor, timeout: None, root: False, timedout: None, exitcode: 0, output:
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - adb shell_output: adb -s HT7BH1A05438 wait-for-device shell sync, timeout: None, root: False, timedout: None, exitcode: 0, output:
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - adb shell_bool: adb -s HT7BH1A05438 wait-for-device shell test -e /sdcard/raptor, timeout: None, root: False, timedout: None, exitcode: 1, output:
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-control-server Info: shutting down control server
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - raptor-main Info: finished
[task 2019-09-13T01:43:01.987Z] 01:43:01 ERROR - raptor-main Critical: TEST-UNEXPECTED-FAIL: test 'raptor-tp6m-youtube-watch-geckoview-cold' timed out loading test page: https://www.youtube.com/watch?v=COU5T-Wafa4 pending metrics: fcp, fnb paint
[task 2019-09-13T01:43:01.987Z] 01:43:01 ERROR - Return code: 1
[task 2019-09-13T01:43:01.987Z] 01:43:01 WARNING - setting return code to 1
[task 2019-09-13T01:43:01.987Z] 01:43:01 INFO - Killing logcat pid 16906.

Comment 7

[Intermittent Failures Robot]

1 failures in 4637 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1558006&startday=2019-09-09&endday=2019-09-15&tree=all

Comment 8

[Florin Strugariu [:Bebe]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 9

[Alexandru Michis [:malexandru]]

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=293005230&repo=autoland&lineNumber=2415

Comment 10

[Intermittent Failures Robot]

3 failures in 5336 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1558006&startday=2020-03-09&endday=2020-03-15&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 5015 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1558006&startday=2020-03-30&endday=2020-04-05&tree=all

Comment 12

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.