Closed Bug 1557842 Opened 6 years ago Closed 5 years ago

Intermittent raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6m-allrecipes-geckoview-cold' timed out loading test page: https://www.allrecipes.com/ pending metrics: fcp, fnb paint, dcf, load time

Categories

(Testing :: Raptor, defect, P5)

Product:
Testing
Component:
Raptor
Version:
Version 3
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure, regression)

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=250556723&repo=mozilla-inbound
Full log: https://queue.taskcluster.net/v1/task/OiZfhZWITP6AQf6VIEz_6A/runs/0/artifacts/public/logs/live_backing.log

18:37:43 INFO - raptor-main starting geckoview
18:37:44 INFO - adb shell_output: adb -s ZY322MQ97M wait-for-device shell am force-stop org.mozilla.geckoview_example; echo adb_returncode=$?, timeout: None, root: False, timedout: None, exitcode: 0, output:
18:37:44 INFO - adb Granting important runtime permissions to org.mozilla.geckoview_example
18:37:45 INFO - adb shell_output: adb -s ZY322MQ97M wait-for-device shell pm grant org.mozilla.geckoview_example android.permission.WRITE_EXTERNAL_STORAGE; echo adb_returncode=$?, timeout: None, root: False, timedout: None, exitcode: 0, output:
18:37:46 INFO - adb shell_output: adb -s ZY322MQ97M wait-for-device shell pm grant org.mozilla.geckoview_example android.permission.READ_EXTERNAL_STORAGE; echo adb_returncode=$?, timeout: None, root: False, timedout: None, exitcode: 0, output:

18:39:30 INFO - raptor-output combining results from browser cycle 13 for raptor-tp6m-allrecipes-geckoview-cold
18:39:30 INFO - raptor-output adding replicates for dcf
18:39:30 INFO - raptor-output adding replicates for fcp
18:39:30 INFO - raptor-output adding replicates for fnbpaint
18:39:30 INFO - raptor-output adding replicates for loadtime
18:39:30 INFO - raptor-output PERFHERDER_DATA: {"framework": {"name": "raptor"}, "suites": [{"extraOptions": [], "name": "raptor-tp6m-imdb-geckoview-cold", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 2364.98, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1829, "replicates": [1803, 1882, 1886, 1206, 1800, 1787, 1800, 1825, 1871, 1743, 1876, 1845, 2236, 1829, 1993], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 2157, "shouldAlert": true, "replicates": [2154, 2199, 2226, 1341, 2148, 2111, 2136, 2157, 2210, 2084, 2198, 2164, 2574, 2148, 2314], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1856, "replicates": [1839, 1902, 1923, 1035, 1849, 1811, 1836, 1856, 1920, 1782, 1897, 1864, 2270, 1849, 2012], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 4272, "shouldAlert": true, "replicates": [4180, 4334, 4309, 4284, 4211, 4124, 4238, 4233, 4272, 4153, 4578, 4154, 4588, 4318, 4306], "unit": "ms"}], "type": "pageload", "unit": "ms"}, {"extraOptions": [], "name": "raptor-tp6m-allrecipes-geckoview-cold", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 2552.86, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 2152, "replicates": [1583, 1587, 1968, 2091, 2193, 2193, 2153, 1547, 2141, 2256, 2152, 2239, 6319], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1622, "shouldAlert": true, "replicates": [1752, 1778, 1574, 1543, 1613, 1578, 1614, 1726, 1601, 1652, 1622, 1694, 1794], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1473, "replicates": [1602, 1627, 1427, 1395, 1463, 1429, 1453, 1570, 1444, 1505, 1473, 1544, 1650], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 8258, "shouldAlert": true, "replicates": [8219, 8312, 8186, 8223, 8222, 8376, 8340, 8090, 8258, 8528, 8185, 8521, 8348], "unit": "ms"}], "type": "pageload", "unit": "ms"}]}
18:39:30 INFO - raptor-output results can also be found locally at: /builds/task_1559930870/workspace/build/raptor.json
18:39:30 INFO - raptor-main removing test folder for raptor: /sdcard/raptor
18:39:31 INFO - adb shell_output: adb -s ZY322MQ97M wait-for-device shell rm -r /sdcard/raptor; echo adb_returncode=$?, timeout: None, root: False, timedout: None, exitcode: 0, output:
18:39:31 INFO - raptor-control-server shutting down control server
18:39:31 INFO - raptor-main finished
18:39:31 INFO - raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6m-allrecipes-geckoview-cold' timed out loading test page: https://www.allrecipes.com/ pending metrics: fcp, fnb paint, dcf, load time
18:39:31 ERROR - Return code: 1
18:39:31 WARNING - setting return code to 1

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → INCOMPLETE

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: REOPENED → RESOLVED
Closed: 6 years ago → 5 years ago
Resolution: --- → INCOMPLETE

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=273758961&repo=autoland&lineNumber=1921

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: REOPENED → RESOLVED
Closed: 5 years ago → 5 years ago
Resolution: --- → INCOMPLETE

Recent failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=278565147&repo=autoland&lineNumber=1839

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: REOPENED → RESOLVED
Closed: 5 years ago → 5 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.