1540520 - Intermittent Tier 2 raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6-instagram-chrome' timed out loading test page: https://www.instagram.com/ pending metrics: fcp, load time

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: btara [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=237194377&repo=mozilla-central

https://queue.taskcluster.net/v1/task/ebc43buSSqWkjsY4o1HFfw/runs/0/artifacts/public/logs/live_backing.log

10:16:08 INFO - raptor-control-server received webext_status: results received
10:16:08 INFO - 127.0.0.1 - - [31/Mar/2019 10:16:08] "POST / HTTP/1.1" 200 -
10:16:08 INFO - raptor-control-server received webext_results: {u'expected_browser_cycles': 1, u'subtest_unit': u'ms', u'name': u'raptor-tp6-yahoo-mail-chrome', u'lower_is_better': True, u'measurements': {u'fcp': [592.160000000149, 101.91500000291853, 99.7849999985192, 101.7699999974866, 103.0350000000908, 102.7200000025914, 104.96999999668333, 107.00999999971827, 104.87999999895692, 105.04500000024564, 101.78500000256463, 121.28999999913503, 104.0099999991071, 101.87500000029104, 108.06500000035157, 119.62499999935972, 106.35499999989406, 101.65000000051805, 130.37999999869498, 101.38000000006286, 105.79999999754364, 104.36500000287197, 100.09999999965657, 99.37500000160071, 102.5950000002922], u'loadtime': [3738, 2641, 2280, 2353, 2625, 2382, 2666, 2532, 2678, 2619, 2607, 2623, 2282, 2393, 2578, 2229, 2264, 2064, 2714, 2539, 2455, 2482, 2266, 2612, 2462]}, u'browser_cycle': u'1', u'subtest_lower_is_better': True, u'cold': False, u'browser': u'Chrome/75.0.3752.0', u'type': u'pageload', u'page': u'https://mail.yahoo.com/', u'unit': u'ms', u'alert_threshold': 2}
10:16:08 INFO - results-handler received results in RaptorResultsHandler.add
10:16:08 INFO - 127.0.0.1 - - [31/Mar/2019 10:16:08] "POST / HTTP/1.1" 200 -
10:16:08 INFO - raptor-control-server received webext_status: __raptor_shutdownBrowser
10:16:08 INFO - raptor-control-server shutting down browser (pid: 2206)
10:16:08 INFO - 127.0.0.1 - - [31/Mar/2019 10:16:08] "POST / HTTP/1.1" 200 -
10:16:08 INFO - raptor-control-server received webext_status: Removed tab 4
10:16:25 INFO - mozproxy Stopping mitmproxy playback, killing process 2204
10:16:25 INFO - mozproxy Successfully killed the mitmproxy playback process
10:16:25 INFO - raptor-main removing webext /Users/cltbld/tasks/task_1553996961/build/tests/raptor/raptor/../webext/raptor
10:16:25 INFO - results-handler summarizing raptor test results
10:16:25 INFO - raptor-output ignoring the first fcp value due to initial pageload noise
10:16:25 INFO - raptor-output turning on subtest alerting for measurement type: fcp
10:16:25 INFO - raptor-output ignoring the first loadtime value due to initial pageload noise
10:16:25 INFO - raptor-output turning on subtest alerting for measurement type: loadtime
10:16:25 INFO - raptor-output ignoring the first fcp value due to initial pageload noise
10:16:25 INFO - raptor-output turning on subtest alerting for measurement type: fcp
10:16:25 INFO - raptor-output ignoring the first loadtime value due to initial pageload noise
10:16:25 INFO - raptor-output turning on subtest alerting for measurement type: loadtime
10:16:25 INFO - raptor-output PERFHERDER_DATA: {"framework": {"name": "raptor"}, "suites": [{"extraOptions": [], "name": "raptor-tp6-twitter-chrome", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 297.37, "subtests": [{"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 177.22499999945285, "shouldAlert": true, "replicates": [834.9799999996321, 748.7549999968905, 184.49999999938882, 192.15500000063912, 147.57000000099652, 383.2250000014028, 372.34499999976833, 187.06999999994878, 174.83999999967637, 175.2650000016729, 180.59999999968568, 174.97500000172295, 175.5250000023807, 183.324999998149, 158.49500000331318, 171.64000000047963, 174.97999999977765, 178.64499999996042, 169.99999999825377, 163.31999999965774, 175.80499999894528, 198.04499999736436, 154.77000000100816, 247.14999999923748, 199.75500000145985], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 498.5, "shouldAlert": true, "replicates": [1627, 1964, 450, 418, 386, 484, 406, 510, 549, 568, 409, 487, 474, 483, 553, 473, 516, 568, 516, 465, 538, 562, 393, 597, 562], "unit": "ms"}], "type": "pageload", "unit": "ms"}, {"extraOptions": [], "name": "raptor-tp6-yahoo-mail-chrome", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 511.0, "subtests": [{"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 103.52249999959895, "shouldAlert": true, "replicates": [592.160000000149, 101.91500000291853, 99.7849999985192, 101.7699999974866, 103.0350000000908, 102.7200000025914, 104.96999999668333, 107.00999999971827, 104.87999999895692, 105.04500000024564, 101.78500000256463, 121.28999999913503, 104.0099999991071, 101.87500000029104, 108.06500000035157, 119.62499999935972, 106.35499999989406, 101.65000000051805, 130.37999999869498, 101.38000000006286, 105.79999999754364, 104.36500000287197, 100.09999999965657, 99.37500000160071, 102.5950000002922], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 2507.0, "shouldAlert": true, "replicates": [3738, 2641, 2280, 2353, 2625, 2382, 2666, 2532, 2678, 2619, 2607, 2623, 2282, 2393, 2578, 2229, 2264, 2064, 2714, 2539, 2455, 2482, 2266, 2612, 2462], "unit": "ms"}], "type": "pageload", "unit": "ms"}]}
10:16:25 INFO - raptor-output results can also be found locally at: /Users/cltbld/tasks/task_1553996961/build/raptor.json
10:16:25 INFO - raptor-control-server shutting down control server
10:16:25 INFO - raptor-main finished
10:16:25 INFO - raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6-instagram-chrome' timed out loading test page: https://www.instagram.com/ pending metrics: fcp, load time
10:16:25 ERROR - Return code: 1
10:16:25 WARNING - setting return code to 1
10:16:26 INFO - Validating PERFHERDER_DATA against /Users/cltbld/tasks/task_1553996961/mozharness/external_tools/performance-artifact-schema.json
10:16:26 INFO - copying raptor results to upload dir:
10:16:26 INFO - /Users/cltbld/tasks/task_1553996961/build/blobber_upload_dir/perfherder-data.json
10:16:26 INFO - copying raptor results from /Users/cltbld/tasks/task_1553996961/build/raptor.json to /Users/cltbld/tasks/task_1553996961/build/blobber_upload_dir/perfherder-data.json
10:16:26 INFO - Running pre test command check_screen_resolution with 'bash -c screenresolution get && screenresolution list && system_profiler SPDisplaysDataType'
10:16:26 INFO - Running command: ('bash', '-c', 'screenresolution get && screenresolution list && system_profiler SPDisplaysDataType') in /Users/cltbld/tasks/task_1553996961/build
10:16:26 INFO - Copy/paste: bash -c "screenresolution get && screenresolution list && system_profiler SPDisplaysDataType"

Comment 1

[Intermittent Failures Robot]

1 failures in 3910 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• osx-10-10-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540520&startday=2019-03-25&endday=2019-03-31&tree=all

Comment 2

[Intermittent Failures Robot]

2 failures in 2843 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1540520&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 3

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup