Closed Bug 1231408 Opened 4 years ago Closed 4 years ago

Add a job to run mochitest-browser-chrome "screenshots" subsuite on Yosemite Try

Categories

(Release Engineering :: General, defect)

defect
Not set

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: MattN, Assigned: MattN)

References

Details

(Whiteboard: [browser-chrome-screenshots])

Attachments

(2 files)

In bug 1169179 I'm adding a screenshots subsuite to take screenshots of the browser chrome to detect regressions. I'd like to get this running in automation by request on Try server but also on a regular interval probably m-c Nightlies, if possible.
adding some smart people on here to help figure out any schedulers to attach to.
Bug 1231408 - Add browser-chrome-screenshots to yosemite_r7 on Try. r?armenzg
Attachment #8697359 - Flags: review?(armenzg)
I'm looking to have this run by request on Try but I'm not sure if this is correct.
Assignee: nobody → MattN+bmo
Status: NEW → ASSIGNED
thanks MattN!  Armen, MattN and I were hacking on this today- I think it does the right things, but there are unknowns if this is hidden on try or if we are doing all the right things.

Builders added:
+ Rev5 MacOSX Yosemite 10.10.5 try opt test mochitest-browser-screenshots
Bug 1231408 - Add browser-chrome-screenshots to run the screenshots subsuite. r=armenzg
Attachment #8697361 - Flags: review?(armenzg)
Comment on attachment 8697359 [details]
MozReview Request: Bug 1231408 - Add browser-chrome-screenshots to yosemite_r7 on Try. r?armenzg

https://reviewboard.mozilla.org/r/27569/#review24915
Attachment #8697359 - Flags: review?(armenzg) → review+
Attachment #8697361 - Flags: review?(armenzg) → review+
Comment on attachment 8697361 [details]
MozReview Request: Bug 1231408 - Add browser-chrome-screenshots to run the screenshots subsuite. r=armenzg

https://reviewboard.mozilla.org/r/27573/#review24917
Armen, will this change make it run by default on Try or only by request? What would the try syntax be to only run this test job after?
Flags: needinfo?(armenzg)
Hi Matt,
It will run by default. We don't have the default/non-default switch for test jobs (only build jobs). bug 1116275.

You can ask the sheriffs to hide the job on try if you don't want it to show up by default.

If you *only* want to run the suite, I think you will have to use -u browser-chrome-screenshots.
Flags: needinfo?(armenzg)
Well, that's not exactly true, or true but not complete. Because 10.10 tests don't run by default, just like anything else on 10.10 (we expect, unless things go awry) it won't run with just -u all, only with -u all[10.10] or -u browser-chrome-screenshots[10.10].
Summary: Add a job to run mochitest-browser-chrome "screenshots" subsuite on Nightlies → Add a job to run mochitest-browser-chrome "screenshots" subsuite on Yosemite Try
Whiteboard: [browser-chrome-screenshots]
buildbot config change needs to land once the in-tree stuff has propagated to more trees
Keywords: leave-open
Status: ASSIGNED → RESOLVED
Closed: 4 years ago
Keywords: leave-open
Resolution: --- → FIXED
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.