There are 16 failures in the last 7 days
Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=229998366&repo=autoland&lineNumber=2188
23:52:08 INFO - raptor-mitmproxy Successfully killed the mitmproxy playback process
23:52:08 INFO - raptor-mitmproxy Turning off the browser proxy
23:52:08 INFO - raptor-mitmproxy writing: /home/cltbld/tasks/task_1550878800/build/application/firefox/distribution/policies.json
23:52:08 INFO - raptor-main removing webext /home/cltbld/tasks/task_1550878800/build/tests/raptor/webext/raptor
23:52:08 INFO - results-handler summarizing raptor test results
23:52:08 INFO - raptor-output ignoring the first dcf value due to initial pageload noise
23:52:08 INFO - raptor-output ignoring the first fcp value due to initial pageload noise
23:52:08 INFO - raptor-output turning on subtest alerting for measurement type: fcp
23:52:08 INFO - raptor-output ignoring the first fnbpaint value due to initial pageload noise
23:52:08 INFO - raptor-output ignoring the first ttfi value due to initial pageload noise
23:52:08 INFO - raptor-output ignoring the first loadtime value due to initial pageload noise
23:52:08 INFO - raptor-output PERFHERDER_DATA: {"framework": {"name": "raptor"}, "suites": [{"extraOptions": [], "name": "raptor-tp6-apple-firefox", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 444.61, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 321.0, "replicates": [765, 327, 345, 320, 368, 359, 330, 297, 324, 293, 304, 295, 312, 310, 324, 317, 338, 358, 351, 310, 322, 298, 298, 297, 356], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 325.0, "shouldAlert": true, "replicates": [522, 354, 373, 352, 401, 311, 272, 322, 354, 316, 347, 320, 181, 328, 223, 347, 279, 385, 279, 338, 352, 319, 319, 328, 297], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 305.5, "replicates": [516, 345, 364, 340, 389, 294, 257, 304, 344, 298, 324, 302, 174, 306, 206, 337, 260, 378, 264, 319, 344, 305, 305, 320, 286], "unit": "ms"}, {"name": "ttfi", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1075.0, "replicates": [1656, 1095, 1132, 1078, 1126, 1072, 1092, 1061, 1093, 1060, 1039, 1097, 1093, 1033, 1049, 1075, 1022, 1108, 1021, 1075, 1094, 1044, 1080, 1067, 1059], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 506.5, "replicates": [1171, 537, 563, 510, 576, 503, 534, 502, 526, 494, 483, 516, 531, 465, 492, 502, 473, 562, 470, 520, 535, 496, 514, 497, 498], "unit": "ms"}], "type": "pageload", "unit": "ms"}]}
23:52:08 INFO - raptor-output results can also be found locally at: /home/cltbld/tasks/task_1550878800/build/raptor.json
23:52:08 INFO - raptor-control-server shutting down control server
23:52:08 INFO - raptor-main finished
23:52:08 INFO - raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6-microsoft-firefox' timed out loading test page: https://www.microsoft.com/en-us/windows/get-windows-10
23:52:08 ERROR - Return code: 1
23:52:08 WARNING - setting return code to 1
23:52:08 INFO - Validating PERFHERDER_DATA against /home/cltbld/tasks/task_1550878800/mozharness/external_tools/performance-artifact-schema.json