1530191 - Intermittent raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6-google-firefox' timed out loading test page: https://www.google.com/search?hl=en&q=barack+obama&cad=h

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: rmaries [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=230161711&repo=autoland

https://queue.taskcluster.net/v1/task/fMQ-UwKKS2OdhTGfb20wVQ/runs/0/artifacts/public/logs/live_backing.log

14:13:05 INFO - raptor-control-server received webext_results: {u'subtest_unit': u'ms', u'name': u'raptor-tp6-youtube-firefox', u'type': u'pageload', u'measurements': {u'dcf': [2435, 1387, 1285, 1334, 918, 1249, 1296, 1157, 993, 2084, 1008, 1354, 1086, 1287, 1221, 1264, 1286, 1224, 1325, 1195, 1288, 1406, 1159, 1284, 1279], u'fcp': [1068, 766, 714, 741, 496, 757, 732, 605, 555, 796, 314, 738, 545, 726, 727, 620, 660, 648, 739, 575, 696, 723, 704, 691, 794], u'fnbpaint': [412, 223, 175, 208, 144, 288, 260, 161, 204, 349, 208, 325, 206, 275, 253, 274, 299, 217, 278, 182, 238, 202, 206, 299, 319], u'hero:hero1': [3017, 2084, 1857, 1921, 1620, 2016, 1920, 1735, 1611, 2727, 1438, 2064, 1851, 1735, 1836, 1808, 1832, 2567, 1807, 1736, 2000, 2889, 1826, 1895, 1880], u'loadtime': [3155, 1871, 1692, 1653, 1263, 1749, 1564, 1305, 1275, 2451, 1353, 1696, 1630, 1634, 1506, 1576, 1628, 1393, 1596, 1487, 1902, 1545, 1591, 1640, 1546]}, u'subtest_lower_is_better': True, u'browser': u'Firefox 67.0a1 20190224130719', u'lower_is_better': True, u'page': u'https://www.youtube.com', u'unit': u'ms', u'alert_threshold': 2}
14:13:05 INFO - results-handler received results in RaptorResultsHandler.add
14:13:05 INFO - 127.0.0.1 - - [24/Feb/2019 06:13:05] "POST / HTTP/1.1" 200 -
14:13:05 INFO - raptor-control-server received webext_status: __raptor_shutdownBrowser
14:13:05 INFO - raptor-control-server shutting down browser (pid: 1961)
14:13:05 INFO - 127.0.0.1 - - [24/Feb/2019 06:13:05] "POST / HTTP/1.1" 200 -
14:13:05 INFO - raptor-control-server received webext_status: Removed tab 3
14:13:05 ERROR - PID 1961 | JavaScript error: resource://gre/modules/WebProgressChild.jsm, line 61: TypeError: this.mm.content is null
14:13:22 INFO - raptor-mitmproxy Stopping mitmproxy playback, klling process 1959
14:13:22 INFO - Replaying from files: ['/Users/cltbld/tasks/task_1551005469/testing/raptor/youtube.mp']
14:13:33 INFO - raptor-mitmproxy Successfully killed the mitmproxy playback process
14:13:33 INFO - raptor-mitmproxy Turning off the browser proxy
14:13:33 INFO - raptor-mitmproxy writing: /Users/cltbld/tasks/task_1551005469/build/application/Firefox Nightly.app/Contents/Resources/distribution/policies.json
14:13:33 INFO - raptor-main removing webext /Users/cltbld/tasks/task_1551005469/build/tests/raptor/webext/raptor
14:13:33 INFO - results-handler summarizing raptor test results
14:13:33 INFO - raptor-output ignoring the first fcp value due to initial pageload noise
14:13:33 INFO - raptor-output turning on subtest alerting for measurement type: fcp
14:13:33 INFO - raptor-output ignoring the first fnbpaint value due to initial pageload noise
14:13:33 INFO - raptor-output ignoring the first hero:hero1 value due to initial pageload noise
14:13:33 INFO - raptor-output ignoring the first loadtime value due to initial pageload noise
14:13:33 INFO - raptor-output turning on subtest alerting for measurement type: loadtime
14:13:33 INFO - raptor-output ignoring the first dcf value due to initial pageload noise
14:13:33 INFO - raptor-output ignoring the first ttfi value due to initial pageload noise
14:13:33 INFO - raptor-output ignoring the first dcf value due to initial pageload noise
14:13:33 INFO - raptor-output ignoring the first fcp value due to initial pageload noise
14:13:33 INFO - raptor-output turning on subtest alerting for measurement type: fcp
14:13:33 INFO - raptor-output ignoring the first fnbpaint value due to initial pageload noise
14:13:33 INFO - raptor-output ignoring the first hero:hero1 value due to initial pageload noise
14:13:33 INFO - raptor-output ignoring the first loadtime value due to initial pageload noise
14:13:33 INFO - raptor-output turning on subtest alerting for measurement type: loadtime
14:13:33 INFO - raptor-output PERFHERDER_DATA: {"framework": {"name": "raptor"}, "suites": [{"extraOptions": [], "name": "raptor-tp6-amazon-firefox", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 855.47, "subtests": [{"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 574.0, "shouldAlert": true, "replicates": [1478, 628, 686, 650, 515, 630, 723, 495, 475, 658, 645, 576, 652, 489, 595, 628, 546, 572, 690, 517, 534, 547, 558, 464, 474], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 544.0, "replicates": [1387, 580, 663, 619, 489, 594, 690, 463, 456, 617, 602, 544, 610, 452, 571, 595, 501, 544, 660, 484, 499, 524, 524, 430, 444], "unit": "ms"}, {"name": "hero:hero1", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1026.5, "replicates": [3092, 1000, 1409, 1283, 1106, 916, 1026, 982, 720, 1041, 1027, 903, 1396, 1081, 1091, 916, 921, 1092, 1210, 1138, 809, 841, 1350, 697, 770], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 768.0, "shouldAlert": true, "replicates": [2064, 845, 1049, 1047, 725, 769, 905, 661, 618, 970, 931, 804, 1134, 735, 746, 767, 805, 767, 880, 744, 696, 740, 983, 617, 648], "unit": "ms"}, {"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 719.0, "replicates": [1601, 776, 794, 763, 657, 735, 856, 600, 584, 868, 827, 718, 763, 623, 710, 721, 707, 724, 811, 645, 664, 720, 702, 583, 597], "unit": "ms"}, {"name": "ttfi", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 2213.0, "replicates": [3662, 2483, 2040, 2128, 2158, 2237, 2206, 1999, 2151, 2248, 2458, 2140, 2454, 2164, 2284, 2551, 2212, 2214, 2452, 2409, 1908, 2324, 2342, 2098, 2202], "unit": "ms"}], "type": "pageload", "unit": "ms"}, {"extraOptions": [], "name": "raptor-tp6-youtube-firefox", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 908.84, "subtests": [{"name": "dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1281.5, "replicates": [2435, 1387, 1285, 1334, 918, 1249, 1296, 1157, 993, 2084, 1008, 1354, 1086, 1287, 1221, 1264, 1286, 1224, 1325, 1195, 1288, 1406, 1159, 1284, 1279], "unit": "ms"}, {"name": "fcp", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 709.0, "shouldAlert": true, "replicates": [1068, 766, 714, 741, 496, 757, 732, 605, 555, 796, 314, 738, 545, 726, 727, 620, 660, 648, 739, 575, 696, 723, 704, 691, 794], "unit": "ms"}, {"name": "fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 230.5, "replicates": [412, 223, 175, 208, 144, 288, 260, 161, 204, 349, 208, 325, 206, 275, 253, 274, 299, 217, 278, 182, 238, 202, 206, 299, 319], "unit": "ms"}, {"name": "hero:hero1", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1854.0, "replicates": [3017, 2084, 1857, 1921, 1620, 2016, 1920, 1735, 1611, 2727, 1438, 2064, 1851, 1735, 1836, 1808, 1832, 2567, 1807, 1736, 2000, 2889, 1826, 1895, 1880], "unit": "ms"}, {"name": "loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1593.5, "shouldAlert": true, "replicates": [3155, 1871, 1692, 1653, 1263, 1749, 1564, 1305, 1275, 2451, 1353, 1696, 1630, 1634, 1506, 1576, 1628, 1393, 1596, 1487, 1902, 1545, 1591, 1640, 1546], "unit": "ms"}], "type": "pageload", "unit": "ms"}]}
14:13:33 INFO - raptor-output results can also be found locally at: /Users/cltbld/tasks/task_1551005469/build/raptor.json
14:13:33 INFO - raptor-control-server shutting down control server
14:13:33 INFO - raptor-main finished
14:13:33 INFO - raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6-google-firefox' timed out loading test page: https://www.google.com/search?hl=en&q=barack+obama&cad=h
14:13:33 ERROR - Return code: 1
14:13:33 WARNING - setting return code to 1

Comment 1

[Intermittent Failures Robot]

1 failures in 2602 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• osx-10-10: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530191&startday=2019-02-18&endday=2019-02-24&tree=all

Comment 2

[Intermittent Failures Robot]

7 failures in 2818 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-inbound: 2
• mozilla-central: 3

Platform breakdown:

• windows10-64: 1
• linux64: 2
• linux64-pgo-qr: 2
• windows10-64-pgo-qr: 1
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530191&startday=2019-03-04&endday=2019-03-10&tree=all

Comment 3

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 4

[Arthur Iakab [arthur_iakab]]

Recent failure https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception&classifiedState=unclassified&selectedJob=246947454&revision=c215a31ef6ea248566743ad6f9fd471e356c7b80&searchStr=linux%2Cx64%2Cquantumrender%2Cshippable%2Copt%2Craptor%2Cperformance%2Ctests%2Con%2Cfirefox%2Ctest-linux64-shippable-qr%2Fopt-raptor-tp6-1-firefox-e10s%2Crap%28tp6-1%29

Failure log https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception&classifiedState=unclassified&selectedJob=246947454&revision=c215a31ef6ea248566743ad6f9fd471e356c7b80&searchStr=linux%2Cx64%2Cquantumrender%2Cshippable%2Copt%2Craptor%2Cperformance%2Ctests%2Con%2Cfirefox%2Ctest-linux64-shippable-qr%2Fopt-raptor-tp6-1-firefox-e10s%2Crap%28tp6-1%29

Comment 5

[Intermittent Failures Robot]

1 failures in 4658 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530191&startday=2019-05-13&endday=2019-05-19&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 4730 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530191&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 7

[Intermittent Failures Robot]

1 failures in 5197 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1530191&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 8

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup