1291015 - migrate mochitest-plain from windows HW -> AWS

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

windows 7 mochitest-plain is almost ready to migrate all of the 5 chunks (+- e10s, opt, debug) to AWS.

There are a few things preventing this:
1) move another test to clipboard
2) plugin tests fail a bit more frequently (about 3 times as much as HW)

While there are bugs on file for the plugin tests, they are not actionable.  A shortcut is to move dom/tests/plugins to the clipboard job and reap the benefits of 20 jobs moved over to AWS.

here is a nice try run:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=89290d4eb27753bc93f8d4e8a7ecdb5975c59641

the debug e10s-3 chunk has a few common failures, these are failing at the same rate on HW, so there are no concerns.

2 things to do:
1) verify the clipboard job is stable on all platforms
2) determine if we really want to move the plugins to the clipboard job

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

:RyanVM- do you have thoughts on the plugin tests, concerns about moving them to the clipboard job which remains on HW?

Comment 2

[Ryan VanderMeulen [:RyanVM]]

Ugh, they're already a trainwreck as-is on the hardware test machines with all the random timeouts they hit. I think leaving them on hardware is the way to go, but I'm CCing Jim and Benjamin in case they have other opinions here.

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1291015 - move more clipboard tests and plugin tests to the hardware based m-cl job.

Review commit: https://reviewboard.mozilla.org/r/69020/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/69020/

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

this review request is almost 2 weeks old, :ryanvm, can you look at it or assign it to someone else?

Comment 5

[Ryan VanderMeulen [:RyanVM]]

Comment on attachment 8777488 [details]
Bug 1291015 - move more clipboard tests and plugin tests to the hardware based m-cl job.

https://reviewboard.mozilla.org/r/69020/#review69164

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/50af52da5bc2
move more clipboard tests and plugin tests to the hardware based m-cl job. r=RyanVM

Comment 7

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/50af52da5bc2

Comment 8

[Joel Maher ( :jmaher ) (UTC -8)]

still need to migrate in buildbot- Testing again a few weeks later (last run was August 1st), we have a new failure in test_main.html (bug 1259908).  That is the only test preventing us from migrating these 20 test jobs to VM.

Comment 9

[Chris AtLee [:catlee]]

Attachment: Bug 1291015 - Migrate mochitest to AWS

Review commit: https://reviewboard.mozilla.org/r/73384/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/73384/

Comment 10

[Rail Aliiev [:rail]]

Comment on attachment 8783653 [details]
Bug 1291015 - Migrate mochitest to AWS

https://reviewboard.mozilla.org/r/73384/#review71158

Comment 11

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/6b5ab7e5fa62