1546323 - Run cold page load tests against Fennec v64 in CI

Status: RESOLVED FIXED

(Testing :: Raptor, enhancement, P1)

Comment 1

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Attachment: Bug 1546323 Run cold page load tests against Fennec v64 in CI

Comment 2

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Try build:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=fd98220045b0db8d2b898acbb5877e60adb3c036

Comment 3

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Another try build. Still timeouts all over.
https://treeherder.mozilla.org/#/jobs?repo=try&revision=d909096da06a51ab6d3944f8ca0f72373475d20e&selectedJob=242344544

Comment 4

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Try build with timeouts fixed. Duration is still around 25 minutes:
Pixel2: https://treeherder.mozilla.org/#/jobs?repo=try&revision=abb90b837bad5002f0b51957245fab19a39e4f93
Moto G5: https://treeherder.mozilla.org/#/jobs?repo=try&revision=9712191db635e145cfab2cad476da8ce521af27a

Comment 5

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Attachment: Bug 1546323 Run cold page load tests against Fennec v64 in CI

Comment 6

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Latest try build:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=3db9885dcff5444f64a8419ae598311905865bb1

Comment 7

[Alexandru Ionescu (needinfo me) [:alexandrui]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=db94717f8f86eb0508ce439afb1fa77c11a2c850

Comment 8

[Alexandru Ionescu (needinfo me) [:alexandrui]]

:rwood, I have an intermittent on cnn, but this is fennec64. I am not sure we want to engage into fixing intermittents on old versions, and disabling this won't affect the performance comparison between fenix and fennec v64. I wouldn't file a bug. Same for youtube.

Comment 9

[Robert Wood [:rwood]]

(In reply to Alexandru Ionescu from comment #8)

:rwood, I have an intermittent on cnn, but this is fennec64. I am not sure we want to engage into fixing intermittents on old versions, and disabling this won't affect the performance comparison between fenix and fennec v64. I wouldn't file a bug. Same for youtube.

Hey Alex, yes I agree, no point in trying to fix intermittent failures that just happen on v64. However if they become perma-fail then we'll need to disable that particular suite on fennec v64 so not to cause alot of effort for the code sheriffs - but let's see how they go. Thanks!

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/03f986bdfdc3
Run cold page load tests against Fennec v64 in CI r=Bebe

Comment 11

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/03f986bdfdc3

Comment 12

[Robert Wood [:rwood]]

Status update on this please? Thanks!

Comment 13

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Will update, thanks!