Closed Bug 1351272 Opened 5 years ago Closed 5 years ago

enable green windows 7 tests on taskcluster at tier 2

Categories

(Release Engineering :: General, enhancement)

enhancement
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: grenade, Assigned: grenade)

References

(Depends on 3 open bugs)

Details

Attachments

(1 file)

we are currently running only the subset of tests on taskcluster windows workers which are green on both windows 7 and 10.

- disable all windows 10 tests since more effort is needed to get these green.
- enable all green windows 7 tests at tier 2.
- disable the currently orange windows 7 tests:
 - xpcshell [chunks: 7, 8]: bug 1304040 (unsigned binaries)
 - reftest [debug, e10s, chunks: 1, 5]:
   https://bugzilla.mozilla.org/buglist.cgi?quicksearch=%22missing%20output%20line%20for%20total%20leaks%22&list_id=13509980
 - reftest-no-accel [debug, e10s, chunks: 1, 8]:
   https://bugzilla.mozilla.org/buglist.cgi?quicksearch=EXCEPTION_ACCESS_VIOLATION_WRITE&list_id=13509988
windows 7 tests to disable based on: https://treeherder.mozilla.org/#/jobs?repo=try&revision=21ec5855ba0a5b57b44efc8652be38738eb79f61&group_state=expanded&filter-tier=1&filter-tier=2&filter-tier=3&exclusion_profile=false&filter-searchStr=tc&selectedJob=86900524

- also appears that max-run-time should be increased for mochitest-webgl which fails because it exceeds the current 1 hour runtime
Comment on attachment 8851972 [details]
bug 1351272 - enable green windows 7 tests on taskcluster at tier 2;

https://reviewboard.mozilla.org/r/124214/#review126786

this is great, thanks for doing this :grenade.  Please leave this open and ensure we have bugs on file or ni? to get bugs on file for the broken tests (i.e. on e10s, etc.)  Right now the only bug we have is the signing issue, so we will need more bugs.

::: taskcluster/ci/test/test-sets.yml:150
(Diff revision 1)
> -#    - reftest
> -#    - reftest-no-accel
> -#    - mochitest-webgl
> +    - reftest
> +    - reftest-no-accel
> +    - mochitest-webgl
>  
>  # these tests currently run on hardware, but may migrate above when validated
>  #    - mochitest-a11y

please file a followup bug for mochitest-a11y, that is on VM now :)

::: taskcluster/ci/test/tests.yml:876
(Diff revision 1)
>          macosx.*: true
>          default: both
>      loopback-video: true
>      max-run-time:
>          by-test-platform:
> +            windows.*: 7200

can we make this 5400 ?
Attachment #8851972 - Flags: review?(jmaher) → review+
Comment on attachment 8851972 [details]
bug 1351272 - enable green windows 7 tests on taskcluster at tier 2;

https://reviewboard.mozilla.org/r/124214/#review126786

> please file a followup bug for mochitest-a11y, that is on VM now :)

bug 1351307
Pushed by ihsiao@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/739c7705e7b5
enable green windows 7 tests on taskcluster at tier 2; r=jmaher
Keywords: checkin-needed
Depends on: 1351758
Depends on: 1351759
Depends on: 1351761
Depends on: 1351770
Depends on: 1351771
No longer blocks: 1351273
No longer blocks: 1351307
What's left to be done in this bug?
Should we just take care of the dep bugs under bug 1280474? (e.g. a couple of enabling bugs; a couple of dev investigations)

I've asked KWierso about what to do with the dep bugs on this bug on an email thread. We will follow up from there.
either we close this out after moving over a11y, gpu, reftest-debug, or we retitle this bug to be specific- :grenade, I see you have some bugs assigned to you, want to do the honors of getting these last remaining tests turned on my default then closing this bug out?
Flags: needinfo?(rthijssen)
will do. leaving ni to remind to do this in the am.
mochitest-a11y and mochitest-gpu dealt with in bug 1351307
reftest and reftest-no-accel e10s dealt with in bug 1351273
Status: ASSIGNED → RESOLVED
Closed: 5 years ago
Flags: needinfo?(rthijssen)
Resolution: --- → FIXED
Removing leave-open keyword from resolved bugs, per :sylvestre.
Keywords: leave-open
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.