1534164 - Intermittent raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6m-reddit-geckoview' timed out loading test page: https://www.reddit.com

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: nbeleuzu [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=233011194&repo=mozilla-central

https://queue.taskcluster.net/v1/task/JRjnlhrSRU6cGcuoaRMaMA/runs/0/artifacts/public/logs/live_backing.log

22:36:05 INFO - 127.0.0.1 - - [10/Mar/2019 22:36:05] "POST / HTTP/1.1" 200 -
22:36:05 INFO - raptor-control-server received webext_status: update tab 0
22:36:05 INFO - 127.0.0.1 - - [10/Mar/2019 22:36:05] "POST / HTTP/1.1" 200 -
22:36:05 INFO - raptor-control-server received webext_status: test tab updated 0
22:36:11 INFO - 127.0.0.1 - - [10/Mar/2019 22:36:11] "POST / HTTP/1.1" 200 -
22:36:11 INFO - raptor-control-server received webext_status: results received
22:36:11 INFO - 127.0.0.1 - - [10/Mar/2019 22:36:11] "POST / HTTP/1.1" 200 -
22:36:11 INFO - raptor-control-server received webext_results: {u'subtest_unit': u'ms', u'name': u'raptor-tp6m-stackoverflow-geckoview', u'type': u'pageload', u'measurements': {u'dcf': [1083, 525, 526, 629, 553, 557, 485, 477, 498, 504, 610, 546, 654, 587, 484], u'fcp': [1378, 709, 703, 830, 718, 728, 654, 653, 676, 690, 804, 738, 830, 766, 655], u'fnbpaint': [1253, 621, 622, 734, 638, 646, 573, 565, 589, 593, 702, 638, 742, 674, 573], u'ttfi': [1834, 944, 1590, 1066, 2552, 920, 847, 856, 2234, 881, 998, 928, 1015, 953, 842], u'loadtime': [1974, 1036, 1009, 1140, 987, 1019, 915, 926, 954, 969, 1074, 1012, 1083, 1036, 922]}, u'subtest_lower_is_better': True, u'browser': u'Fennec 67.0a1 20190310214003', u'lower_is_better': True, u'page': u'https://stackoverflow.com/', u'unit': u'ms', u'alert_threshold': 2}
22:36:11 INFO - results-handler received results in RaptorResultsHandler.add
22:36:11 INFO - 127.0.0.1 - - [10/Mar/2019 22:36:11] "POST / HTTP/1.1" 200 -
22:36:11 INFO - raptor-control-server received webext_status: __raptor_shutdownBrowser
22:36:11 INFO - raptor-control-server shutting down android app org.mozilla.geckoview_example
22:36:12 INFO - adb shell_output: adb -s ZY322LHD2L wait-for-device shell am force-stop org.mozilla.geckoview_example; echo adb_returncode=$?, timeout: None, root: False, timedout: None, exitcode: 0, output:
22:36:14 INFO - adb command_output: adb -s ZY322LHD2L wait-for-device pull /sdcard/raptor/profile/minidumps /tmp/tmpxSB3KP/minidumps, timeout: None, timedout: None, exitcode: 0, output: pull: building file list...
22:36:14 INFO - /sdcard/raptor/profile/minidumps/: 0 files pulled.
22:36:14 INFO - mozproxy Stopping mitmproxy playback, killing process 787
22:36:14 INFO - Replaying from files: ['/builds/worker/workspace/testing/mozproxy/mitmproxy-recordings-raptor-tp6m-stackoverflow.mp']
22:36:24 INFO - mozproxy Successfully killed the mitmproxy playback process
22:36:24 INFO - raptor-main removing webext /builds/worker/workspace/build/tests/raptor/raptor/../webext/raptor
22:36:24 INFO - results-handler summarizing raptor test results
22:36:24 INFO - raptor-output ignoring the first dcf value due to initial pageload noise
22:36:24 INFO - raptor-output ignoring the first fcp value due to initial pageload noise
22:36:24 INFO - raptor-output turning on subtest alerting for measurement type: fcp
22:36:24 INFO - raptor-output ignoring the first fnbpaint value due to initial pageload noise
22:36:24 INFO - raptor-output ignoring the first ttfi value due to initial pageload noise
22:36:24 INFO - raptor-output ignoring the first loadtime value due to initial pageload noise
22:36:24 INFO - raptor-output turning on subtest alerting for measurement type: loadtime
22:36:24 INFO - raptor-output PERFHERDER_DATA: {"framework": {"name": "raptor"}, "suites": [{"extraOptions": [], "name": "raptor-tp6m-stackoverflow-geckoview", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 745.95, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 536.0, "replicates": [1083, 525, 526, 629, 553, 557, 485, 477, 498, 504, 610, 546, 654, 587, 484], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 713.5, "shouldAlert": true, "replicates": [1378, 709, 703, 830, 718, 728, 654, 653, 676, 690, 804, 738, 830, 766, 655], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 630.0, "replicates": [1253, 621, 622, 734, 638, 646, 573, 565, 589, 593, 702, 638, 742, 674, 573], "unit": "ms"}, {"name": "ttfi", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 948.5, "replicates": [1834, 944, 1590, 1066, 2552, 920, 847, 856, 2234, 881, 998, 928, 1015, 953, 842], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1010.5, "shouldAlert": true, "replicates": [1974, 1036, 1009, 1140, 987, 1019, 915, 926, 954, 969, 1074, 1012, 1083, 1036, 922], "unit": "ms"}], "type": "pageload", "unit": "ms"}]}
22:36:24 INFO - raptor-output results can also be found locally at: /builds/worker/workspace/build/raptor.json
22:36:24 INFO - raptor-control-server shutting down control server
22:36:24 INFO - raptor-main removing reverse socket connections
22:36:24 INFO - adb command_output: adb -s ZY322LHD2L wait-for-device reverse --remove-all, timeout: None, timedout: None, exitcode: 0, output:
22:36:24 INFO - raptor-main finished
22:36:24 INFO - raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6m-reddit-geckoview' timed out loading test page: https://www.reddit.com
22:36:24 ERROR - Return code: 1
22:36:24 WARNING - setting return code to 1
22:36:24 INFO - Killing logcat pid 444.
22:36:24 INFO - Validating PERFHERDER_DATA against /builds/worker/workspace/mozharness/external_tools/performance-artifact-schema.json
22:36:24 INFO - copying raptor results to upload dir:
22:36:24 INFO - /builds/worker/workspace/build/blobber_upload_dir/perfherder-data.json
22:36:24 INFO - copying raptor results from /builds/worker/workspace/build/raptor.json to /builds/worker/workspace/build/blobber_upload_dir/perfherder-data.json
22:36:24 INFO - Running post-action listener: _package_coverage_data
22:36:24 INFO - Running post-action listener: _resource_record_post_action
22:36:24 INFO - Running post-action listener: process_java_coverage_data
22:36:24 INFO - Running post-action listener: stop_device

Comment 1

[Intermittent Failures Robot]

1 failures in 2818 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534164&startday=2019-03-04&endday=2019-03-10&tree=all

Comment 2

[Intermittent Failures Robot]

1 failures in 2561 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534164&startday=2019-03-18&endday=2019-03-24&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 2843 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534164&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 4

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 5

[Noemi Erli[:noemi_erli]]

Recent failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=269663779&repo=mozilla-central&lineNumber=1943

Comment 6

[Intermittent Failures Robot]

1 failures in 4292 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1534164&startday=2019-09-30&endday=2019-10-06&tree=all

Comment 7

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.