1496544 - Don't timeout the pageload / fail raptor test when TTI is not available

Status: RESOLVED FIXED

(Testing :: Raptor, enhancement)

Description

[Robert Wood [:rwood]]

After Bug 1299118 lands, raptor will be measuring TTI in tp6, with an increased number of retries getting / waiting for TTI. However, as :jesup notes, sometimes TTI may not be available - even for the same page. Raptor should handle that.

3:02 PM <jesup> rwood: for the record, sites will fail to *ever* get TTI, so that must be handled in the framework (as we talked about).  So either put in bogus numbers, or allow them to timeout and not kill the run (just omit data)

Comment 1

[Robert Wood [:rwood]]

If the patch in Bug 1299118 has 'dummy' values submitted for TTI (i.e. 0) whenever TTI is not available, just to prevent raptor timeouts, then this bug/patch should handle those 'dummuy' values - i.e. don't include them in the final geometric mean etc.

Comment 2

[Robert Wood [:rwood]]

Attachment: Bug 1496544 - Don't timeout the pageload / fail raptor test when TTFI is not available; r?jmaher

Comment 3

[Robert Wood [:rwood]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=984a1a60eb63779984b176fd8999317e9d8ce7f2

Comment 4

[Robert Wood [:rwood]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=9239984246f39b8325123a928668a78d335c92e3

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e18f1acd0782
Don't timeout the pageload / fail raptor test when TTFI is not available; r=jmaher

Comment 6

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/e18f1acd0782