Closed Bug 1557939 Opened 6 years ago Closed 6 years ago

Intermittent raptor-main Critical: TEST-UNEXPECTED-FAIL: test 'raptor-tp6m-bing-restaurants-fennec' timed out loading test page: https://www.bing.com/search?q=restaurants pending metrics: fnb paint, dcf, load time

Categories

(Testing :: Raptor, defect, P5)

Product:
Testing
Component:
Raptor
Version:
Version 3
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure, regression)

Filed by: nbeleuzu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=250742446&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/MDiVUzmpQPCLoVzCfk2dvg/runs/0/artifacts/public/logs/live_backing.log

05:44:40 INFO - adb shell_output: adb -s ZY3223FBC4 wait-for-device shell am force-stop org.mozilla.firefox; echo adb_returncode=$?, timeout: None, root: False, timedout: None, exitcode: 0, output:
05:44:40 INFO - raptor-main Info: removing reverse socket connections
05:44:41 INFO - adb command_output: adb -s ZY3223FBC4 wait-for-device reverse --remove-all, timeout: None, timedout: None, exitcode: 0, output:
05:44:41 INFO - adb command_output: adb -s ZY3223FBC4 wait-for-device pull /sdcard/raptor/profile/minidumps /tmp/tmpF0j2N0/minidumps, timeout: None, timedout: None, exitcode: 0, output: /sdcard/raptor/profile/minidumps/: 0 files pulled.
05:44:41 INFO - mozproxy Stopping mitmproxy playback, killing process 1391
05:44:41 INFO - mozproxy Successfully killed the mitmproxy playback process
05:44:41 INFO - raptor-main Info: removing webext /builds/task_1559971902/workspace/build/tests/raptor/raptor/../webext/raptor
05:44:41 INFO - raptor-results-handler Info: summarizing raptor test results
05:44:41 INFO - raptor-output Info: ignoring the first dcf value due to initial pageload noise
05:44:41 INFO - raptor-output Info: ignoring the first fnbpaint value due to initial pageload noise
05:44:41 INFO - raptor-output Info: ignoring the first loadtime value due to initial pageload noise
05:44:41 INFO - raptor-output Info: turning on subtest alerting for measurement type: loadtime
05:44:41 INFO - raptor-output Info: ignoring the first dcf value due to initial pageload noise
05:44:41 INFO - raptor-output Info: ignoring the first fnbpaint value due to initial pageload noise
05:44:41 INFO - raptor-output Info: ignoring the first loadtime value due to initial pageload noise
05:44:41 INFO - raptor-output Info: turning on subtest alerting for measurement type: loadtime
05:44:41 INFO - raptor-output Info: ignoring the first dcf value due to initial pageload noise
05:44:41 INFO - raptor-output Info: ignoring the first fnbpaint value due to initial pageload noise
05:44:41 INFO - raptor-output Info: ignoring the first loadtime value due to initial pageload noise
05:44:41 INFO - raptor-output Info: turning on subtest alerting for measurement type: loadtime
05:44:41 INFO - raptor-output Info: screen captures can be found locally at: /builds/task_1559971902/workspace/build/screenshots.html
05:44:41 INFO - raptor-output Info: PERFHERDER_DATA: {"framework": {"name": "raptor"}, "suites": [{"extraOptions": [], "name": "raptor-tp6m-instagram-fennec", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1186.48, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 612.0, "replicates": [653, 543, 707, 791, 645, 709, 605, 911, 723, 518, 573, 502, 619, 509, 584], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 590.0, "replicates": [660, 585, 750, 595, 740, 752, 651, 967, 770, 447, 488, 436, 478, 429, 490], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 4621.0, "shouldAlert": true, "replicates": [4251, 4609, 4778, 5626, 4206, 4334, 4809, 5221, 3596, 5237, 3203, 4071, 5671, 4633, 4192], "unit": "ms"}], "type": "pageload", "unit": "ms"}, {"extraOptions": [], "name": "raptor-tp6m-bing-fennec", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 156.97, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 132.0, "replicates": [328, 130, 138, 132, 143, 164, 132, 131, 125, 137, 125, 142, 131, 131, 139], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 189.0, "replicates": [473, 199, 190, 185, 189, 223, 189, 188, 172, 195, 179, 204, 183, 198, 186], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 155.0, "shouldAlert": true, "replicates": [409, 155, 155, 147, 161, 187, 152, 149, 143, 158, 143, 163, 147, 165, 157], "unit": "ms"}], "type": "pageload", "unit": "ms"}, {"extraOptions": [], "name": "raptor-tp6m-ebay-kleinanzeigen-fennec", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1269.48, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 540.5, "replicates": [1807, 1033, 1154, 551, 545, 536, 461, 404, 1128, 1018, 983, 490, 416, 473, 474], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1088.5, "replicates": [2048, 1691, 1379, 1328, 1136, 1032, 878, 872, 3364, 1468, 1442, 919, 1030, 913, 1041], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 3475.0, "shouldAlert": true, "replicates": [6049, 4143, 4036, 4373, 4560, 3253, 2871, 3180, 5689, 3697, 4637, 3043, 3188, 2770, 2984], "unit": "ms"}], "type": "pageload", "unit": "ms"}]}
05:44:41 INFO - raptor-output Info: results can also be found locally at: /builds/task_1559971902/workspace/build/raptor.json
05:44:41 INFO - raptor-main Info: removing test folder for raptor: /sdcard/raptor
05:44:41 INFO - adb shell_output: adb -s ZY3223FBC4 wait-for-device shell rm -r /sdcard/raptor; echo adb_returncode=$?, timeout: None, root: False, timedout: None, exitcode: 0, output:
05:44:41 INFO - raptor-control-server Info: shutting down control server
05:44:42 INFO - raptor-main Info: finished
05:44:42 ERROR - raptor-main Critical: TEST-UNEXPECTED-FAIL: test 'raptor-tp6m-bing-restaurants-fennec' timed out loading test page: https://www.bing.com/search?q=restaurants pending metrics: fnb paint, dcf, load time
05:44:42 ERROR - Return code: 1
05:44:42 WARNING - setting return code to 1

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.