1520235 - Intermittent raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6-google-mail-firefox' timed out loading test page: https://mail.google.com/

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: btara [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=222008345&repo=mozilla-central

https://queue.taskcluster.net/v1/task/RRZO0M39SQuLYDJsgaEY6w/runs/0/artifacts/public/logs/live_backing.log

09:18:09 INFO - raptor-control-server received webext_status: __raptor_shutdownBrowser
09:18:09 INFO - raptor-control-server shutting down browser (pid: 4786)
09:18:09 INFO - 127.0.0.1 - - [15/Jan/2019 09:18:09] "POST / HTTP/1.1" 200 -
09:18:09 INFO - raptor-control-server received webext_status: Removed tab 1
09:18:26 INFO - raptor-mitmproxy Stopping mitmproxy playback, klling process 4779
09:18:26 INFO - Replaying from files: ['/home/cltbld/tasks/task_1547572154/testing/raptor/pinterest.mp']
09:18:36 INFO - raptor-mitmproxy Successfully killed the mitmproxy playback process
09:18:36 INFO - raptor-mitmproxy Turning off the browser proxy
09:18:36 INFO - raptor-mitmproxy writing: /home/cltbld/tasks/task_1547572154/build/application/firefox/distribution/policies.json
09:18:36 INFO - raptor-main removing webext /home/cltbld/tasks/task_1547572154/build/tests/raptor/webext/raptor
09:18:36 INFO - results-handler summarizing raptor test results
09:18:36 INFO - raptor-output ignoring the first dcf value due to initial pageload noise
09:18:36 INFO - raptor-output ignoring the first fnbpaint value due to initial pageload noise
09:18:36 INFO - raptor-output ignoring the first ttfi value due to initial pageload noise
09:18:36 INFO - raptor-output ignoring the first loadtime value due to initial pageload noise
09:18:36 INFO - raptor-output PERFHERDER_DATA: {"framework": {"name": "raptor"}, "suites": [{"extraOptions": [], "name": "raptor-tp6-pinterest-firefox", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 718.97, "subtests": [{"name": "raptor-tp6-pinterest-firefox-dcf", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 295.5, "replicates": [651, 330, 287, 312, 271, 332, 257, 289, 304, 326, 294, 286, 291, 291, 332, 330, 322, 341, 286, 297, 316, 289, 291, 290, 300], "unit": "ms"}, {"name": "raptor-tp6-pinterest-firefox-fnbpaint", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 354.0, "replicates": [662, 355, 306, 543, 510, 353, 491, 321, 322, 362, 323, 309, 327, 526, 564, 562, 356, 579, 305, 322, 350, 305, 531, 533, 321], "unit": "ms"}, {"name": "raptor-tp6-pinterest-firefox-ttfi", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1770.5, "replicates": [2484, 1975, 1680, 2027, 1634, 1797, 1668, 1886, 1660, 1904, 1860, 1739, 1581, 1747, 1794, 1677, 1630, 1912, 1879, 1679, 1814, 1790, 1640, 1751, 1864], "unit": "ms"}, {"name": "raptor-tp6-pinterest-firefox-loadtime", "lowerIsBetter": true, "alertThreshold": 2.0, "value": 1440.0, "replicates": [2372, 1807, 1405, 1409, 1360, 1438, 1356, 1541, 1421, 1712, 1703, 1373, 1389, 1449, 1442, 1444, 1431, 1747, 1675, 1418, 1488, 1602, 1423, 1420, 1516], "unit": "ms"}], "type": "pageload", "unit": "ms"}]}
09:18:36 INFO - raptor-output results can also be found locally at: /home/cltbld/tasks/task_1547572154/build/raptor.json
09:18:36 INFO - raptor-control-server shutting down control server
09:18:36 INFO - raptor-main finished
09:18:36 INFO - raptor-main TEST-UNEXPECTED-FAIL: test 'raptor-tp6-google-mail-firefox' timed out loading test page: https://mail.google.com/
09:18:36 ERROR - Return code: 1
09:18:36 WARNING - setting return code to 1
09:18:36 INFO - Validating PERFHERDER_DATA against /home/cltbld/tasks/task_1547572154/mozharness/external_tools/performance-artifact-schema.json
09:18:36 INFO - copying raptor results to upload dir:
09:18:36 INFO - /home/cltbld/tasks/task_1547572154/build/blobber_upload_dir/perfherder-data.json
09:18:36 INFO - copying raptor results from /home/cltbld/tasks/task_1547572154/build/raptor.json to /home/cltbld/tasks/task_1547572154/build/blobber_upload_dir/perfherder-data.json
09:18:36 INFO - Running post-action listener: _package_coverage_data
09:18:36 INFO - Running post-action listener: _resource_record_post_action
09:18:36 INFO - Running post-action listener: process_java_coverage_data
09:18:36 INFO - Running post-action listener: stop_device
09:18:36 INFO - [mozharness: 2019-01-15 17:18:36.430792Z] Finished run-tests step (success)

Comment 1

[Intermittent Failures Robot]

11 failures in 2378 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 11

Platform breakdown:

• linux64-qr: 5
• windows10-64: 2
• linux64: 2
• windows10-64-ux: 1
• macosx64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-01-14&endday=2019-01-20&tree=all

Comment 2

[Intermittent Failures Robot]

5 failures in 2383 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1
• mozilla-central: 4

Platform breakdown:

• windows10-64-ux: 1
• linux64: 1
• windows10-64: 2
• windows10-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-01-21&endday=2019-01-27&tree=all

Comment 3

[Intermittent Failures Robot]

3 failures in 2628 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• windows10-64: 1
• osx-10-10: 1
• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-01-28&endday=2019-02-03&tree=all

Comment 4

[Intermittent Failures Robot]

2 failures in 2658 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-ux: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-02-04&endday=2019-02-10&tree=all

Comment 5

[Intermittent Failures Robot]

4 failures in 2832 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform breakdown:

• macosx64-nightly: 1
• windows7-32: 1
• windows10-64-ux: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-02-11&endday=2019-02-17&tree=all

Comment 6

[Intermittent Failures Robot]

6 failures in 2602 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 6

Platform breakdown:

• windows10-64-ux: 4
• windows7-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-02-18&endday=2019-02-24&tree=all

Comment 7

[Intermittent Failures Robot]

2 failures in 2981 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-ux: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-02-25&endday=2019-03-03&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures in 2818 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-03-04&endday=2019-03-10&tree=all

Comment 9

[Intermittent Failures Robot]

2 failures in 2771 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-qr: 1
• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-03-11&endday=2019-03-17&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 2561 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-pgo-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-03-18&endday=2019-03-24&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 3910 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-03-25&endday=2019-03-31&tree=all

Comment 12

[Intermittent Failures Robot]

3 failures in 2843 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• windows10-aarch64: 2
• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 3025 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-04-08&endday=2019-04-14&tree=all

Comment 14

[Intermittent Failures Robot]

1 failures in 2673 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 15

[Intermittent Failures Robot]

3 failures in 3031 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• windows10-64-ux: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 16

[Intermittent Failures Robot]

1 failures in 4131 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-04-29&endday=2019-05-05&tree=all

Comment 17

[Intermittent Failures Robot]

4 failures in 4730 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform breakdown:

• linux64: 1
• windows10-64-shippable: 1
• linux64-shippable: 1
• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 18

[Intermittent Failures Robot]

1 failures in 4753 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 19

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 20

[Razvan Maries]

New occurrence: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=260692958&repo=mozilla-central&lineNumber=5519

Comment 21

[Intermittent Failures Robot]

1 failures in 4666 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ref-hw-2017: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1520235&startday=2019-08-05&endday=2019-08-11&tree=all

Comment 22

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup