1572804 - Begin to build browsertime support into Raptor framework

Status: RESOLVED FIXED

(Testing :: Raptor, enhancement, P1)

Description

[Robert Wood [:rwood]]

Start and build out a Browsertime class within the Raptor framework.

Comment 1

[Robert Wood [:rwood]]

Attachment: Bug 1572804 - Begin to build browsertime support into Raptor framework

Comment 2

[Robert Wood [:rwood]]

(Commandeered Nick's patch from https://bugzilla.mozilla.org/show_bug.cgi?id=1566171#c4)

Comment 3

[Robert Wood [:rwood]]

Attachment: Bug 1572804 - Begin to build browsertime support into Raptor framework

Comment 4

[Robert Wood [:rwood]]

Attachment: Bug 1572804 - Begin to build browsertime support into Raptor framework

Comment 5

[Robert Wood [:rwood]]

This patch (along with the browesertime flag patch in Bug 1573208) adds support for running existing tp6 Firefox desktop tests using browsertime. Example local command line:

./mach raptor-test --browsertime --test raptor-tp6-amazon-firefox --browser-cycles 25

Note that this will use live sites for now - adding playback support will be handled in Bug 1568048. The handling of the results will be done in Bug 1565316.

Comment 6

[Robert Wood [:rwood]]

Attachment: Bug 1572804 - Begin to build browsertime support into Raptor framework (original patch by nalexander)

Comment 7

[Robert Wood [:rwood]]

Attachment: Bug 1572804 - Begin to build browsertime support into Raptor framework (original patch by nalexander)

Comment 8

[Robert Wood [:rwood]]

Try run (btime job itself expected to fail; this patch just adds the basic class for running locally):

https://treeherder.mozilla.org/#/jobs?repo=try&revision=48452ef21001305884e06d04f2fd799c213ac02b

Comment 9

[Robert Wood [:rwood]]

Latest patch on try with non-browsertime jobs for unittests/lint etc:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=7a07033bdcfeb85158c5a631a725d9321a9051d5

Comment 10

[Robert Wood [:rwood]]

Latest patch on try with non-browsertime jobs for unittests/lint etc:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=133db8aad3b4558a1d0a5a2c1178104ee86a7fe7

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/54e1f66f80d8
Begin to build browsertime support into Raptor framework (original patch by nalexander) r=nalexander

Comment 12

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/54e1f66f80d8