Closed Bug 1636137 Opened 5 years ago Closed 5 years ago

Intermittent raptor-main Critical: TEST-UNEXPECTED-FAIL: test 'raptor-tp6-linkedin-firefox' timed out loading test page: waiting for pending metrics

Categories

(Testing :: Raptor, defect, P5)

Product:
Testing
Component:
Raptor
Version:
Version 3
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: ccoroiu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=301162639&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ETxD0A3mRMmMli15HNQfUg/runs/0/artifacts/public/logs/live_backing.log

[task 2020-05-07T08:02:44.810Z] 08:02:44 INFO - perftest-output Info: summarizing mozproxy data
[task 2020-05-07T08:02:44.851Z] 08:02:44 INFO - perftest-output Info: PERFHERDER_DATA: {"framework": {"name": "raptor"}, "application": {"version": "78.0a1", "name": "firefox"}, "suites": [{"subtests": [{"lowerIsBetter": false, "unit": "%", "name": "confidence", "value": 60, "alertThreshold": 2.0}, {"lowerIsBetter": false, "unit": "a.u.", "name": "replayed", "value": 453, "alertThreshold": 2.0}, {"lowerIsBetter": true, "unit": "a.u.", "name": "not-replayed", "value": 300, "alertThreshold": 2.0}], "extraOptions": [], "type": "mozproxy", "name": "raptor-tp6-ebay-firefox"}, {"subtests": [{"lowerIsBetter": false, "unit": "%", "name": "confidence", "value": 80, "alertThreshold": 2.0}, {"lowerIsBetter": false, "unit": "a.u.", "name": "replayed", "value": 105, "alertThreshold": 2.0}, {"lowerIsBetter": true, "unit": "a.u.", "name": "not-replayed", "value": 26, "alertThreshold": 2.0}], "type": "mozproxy", "name": "raptor-tp6-linkedin-firefox"}, {"subtests": [{"lowerIsBetter": false, "unit": "%", "name": "confidence", "value": 2, "alertThreshold": 2.0}, {"lowerIsBetter": false, "unit": "a.u.", "name": "replayed", "value": 59, "alertThreshold": 2.0}, {"lowerIsBetter": true, "unit": "a.u.", "name": "not-replayed", "value": 1979, "alertThreshold": 2.0}], "extraOptions": [], "type": "mozproxy", "name": "raptor-tp6-wikipedia-firefox"}]}
[task 2020-05-07T08:02:44.851Z] 08:02:44 INFO - perftest-output Info: mozproxy results can also be found locally at: C:\Users\task_1588835389\build\raptor-mozproxy.json
[task 2020-05-07T08:02:44.851Z] 08:02:44 INFO - perftest-output Info: screen captures can be found locally at: C:\Users\task_1588835389\build\screenshots.html
[task 2020-05-07T08:02:44.851Z] 08:02:44 INFO - perftest-output Info: PERFHERDER_DATA: {"framework": {"name": "raptor"}, "application": {"version": "78.0a1", "name": "firefox"}, "suites": [{"value": 484.64, "extraOptions": [], "name": "raptor-tp6-ebay-firefox", "tags": ["pageload", "warm"], "lowerIsBetter": true, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 555.5, "replicates": [5725, 757, 696, 621, 556, 635, 535, 550, 525, 564, 501, 520, 869, 723, 635, 536, 557, 565, 543, 547, 522, 555, 634, 532, 512], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 407.0, "shouldAlert": true, "replicates": [2105, 580, 540, 464, 399, 481, 401, 403, 385, 404, 380, 399, 723, 582, 412, 406, 383, 432, 408, 432, 396, 424, 516, 395, 386], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 384.5, "replicates": [1037, 551, 506, 437, 373, 400, 379, 382, 361, 383, 360, 382, 706, 557, 390, 390, 369, 400, 381, 386, 380, 394, 491, 370, 370], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 634.5, "shouldAlert": true, "replicates": [6106, 886, 783, 713, 631, 704, 619, 628, 602, 639, 590, 615, 953, 810, 653, 613, 643, 638, 611, 621, 604, 627, 718, 1324, 585], "unit": "ms"}], "type": "pageload", "alertThreshold": 2.0, "unit": "ms"}, {"value": 1656.99, "extraOptions": [], "name": "raptor-tp6-wikipedia-firefox", "tags": ["pageload", "warm"], "lowerIsBetter": true, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1606.0, "replicates": [13948, 4088, 1509, 1577, 1534, 4663, 17570, 1584, 1510, 2143, 7789, 1579, 1554, 2945, 7643, 3995, 1987, 3008, 1620, 1592, 1557, 1578, 1803, 1591, 1444], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1517.5, "shouldAlert": true, "replicates": [13908, 3972, 1529, 1453, 1410, 4643, 17570, 1476, 1527, 2085, 7719, 1476, 1435, 2836, 5682, 1529, 1936, 1472, 1503, 1498, 1444, 1466, 1659, 1508, 1429], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1497.5, "replicates": [12808, 3948, 1502, 1437, 1393, 4620, 17556, 1458, 1505, 1519, 7706, 1459, 1418, 2818, 5660, 1509, 1924, 1453, 1483, 1482, 1423, 1450, 1645, 1493, 1409], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 2065.5, "shouldAlert": true, "replicates": [14262, 4866, 4405, 1564, 1545, 4687, 21731, 1606, 1744, 2159, 7848, 1599, 1577, 2960, 7694, 4071, 1972, 3023, 1622, 1606, 6779, 1567, 1789, 1605, 3199], "unit": "ms"}], "type": "pageload", "alertThreshold": 2.0, "unit": "ms"}]}
[task 2020-05-07T08:02:44.852Z] 08:02:44 INFO - perftest-output Info: results can also be found locally at: C:\Users\task_1588835389\build\raptor.json
[task 2020-05-07T08:02:50.226Z] 08:02:50 INFO - perftest-results-handler Info: Validating PERFHERDER_DATA against C:\Users\task_1588835389\mozharness\external_tools\performance-artifact-schema.json
[task 2020-05-07T08:02:50.462Z] 08:02:50 INFO - raptor-perftest Info: Removing temporary directory: c:\users\task_1588835389\appdata\local\temp\tmpnl7azv
[task 2020-05-07T08:02:59.518Z] 08:02:59 INFO - raptor-control-server Info: shutting down control server
[task 2020-05-07T08:02:59.703Z] 08:02:59 INFO - raptor-webext Info: finished
[task 2020-05-07T08:02:59.703Z] 08:02:59 INFO - raptor-main Warning: page cycle 1 has pending metrics: fcp, fnb paint, dcf, load time
[task 2020-05-07T08:02:59.703Z] 08:02:59 ERROR - raptor-main Critical: TEST-UNEXPECTED-FAIL: test 'raptor-tp6-linkedin-firefox' timed out loading test page: waiting for pending metrics
[task 2020-05-07T08:03:01.217Z] 08:03:01 ERROR - Return code: 1
[task 2020-05-07T08:03:01.217Z] 08:03:01 WARNING - setting return code to 1
[task 2020-05-07T08:03:01.217Z] 08:03:01 INFO - Copying Raptor results to upload dir:
[task 2020-05-07T08:03:01.218Z] 08:03:01 INFO - C:\Users\task_1588835389\build\blobber_upload_dir\perfherder-data.json
[task 2020-05-07T08:03:01.218Z] 08:03:01 INFO - Copying raptor results from C:\Users\task_1588835389\build\raptor.json to C:\Users\task_1588835389\build\blobber_upload_dir\perfherder-data.json
[task 2020-05-07T08:03:01.220Z] 08:03:01 INFO - Copying raptor results from C:\Users\task_1588835389\build\raptor-mozproxy.json to C:\Users\task_1588835389\build\blobber_upload_dir\perfherder-data-mozproxy.json
[task 2020-05-07T08:03:01.221Z] 08:03:01 INFO - C:\Users\task_1588835389\build\blobber_upload_dir\screenshots.html
[task 2020-05-07T08:03:01.221Z] 08:03:01 INFO - Copying raptor results from C:\Users\task_1588835389\build\screenshots.html to C:\Users\task_1588835389\build\blobber_upload_dir\screenshots.html
[task 2020-05-07T08:03:01.222Z] 08:03:01 INFO - Running post-action listener: _package_coverage_data
[task 2020-05-07T08:03:01.222Z] 08:03:01 INFO - Running post-action listener: _resource_record_post_action
[task 2020-05-07T08:03:01.222Z] 08:03:01 INFO - Running post-action listener: process_java_coverage_data
[task 2020-05-07T08:03:01.222Z] 08:03:01 INFO - Running post-action listener: stop_device

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.