Last Comment Bug 1179955 - Turn on a GTest job in automation
: Turn on a GTest job in automation
Status: RESOLVED FIXED
:
Product: Testing
Classification: Components
Component: General (show other bugs)
: unspecified
: Unspecified Unspecified
-- normal (vote)
: ---
Assigned To: Chris Manchester (:chmanchester)
:
:
Mentors:
Depends on: 1192857
Blocks: 992983
  Show dependency treegraph
 
Reported: 2015-07-02 13:47 PDT by Chris Manchester (:chmanchester)
Modified: 2015-08-10 08:15 PDT (History)
4 users (show)
See Also:
Crash Signature:
(edit)
QA Whiteboard:
Iteration: ---
Points: ---


Attachments
Turn on gtest job on try (11.72 KB, patch)
2015-07-02 15:30 PDT, Chris Manchester (:chmanchester)
rail: review+
Details | Diff | Splinter Review

Description User image Chris Manchester (:chmanchester) 2015-07-02 13:47:31 PDT
I was able to get them running from mozharness locallly, I'd like to enable them on try (or ash, or wherever) to test my work.
Comment 1 User image Benoit Girard (:BenWa) 2015-07-02 14:15:33 PDT
What's the full runtime for GTest these days? When I added it the overhead of doing a job for it would of been much much higher than just running it in the build phase.
Comment 2 User image Chris Manchester (:chmanchester) 2015-07-02 14:27:11 PDT
Quickly looking at logs it's about 3 minutes, so I guess we could combine them with the Cpp job (which already finishes in under 15 minutes).
Comment 3 User image Chris Manchester (:chmanchester) 2015-07-02 15:27:42 PDT
Ok, I'd like to enable a job on try that runs gtests and cppunittests in the same job while we get things up and running, then turn off the cppunittest job when these are ready to be turned on everywhere.

Builders added:
+ Rev4 MacOSX Snow Leopard 10.6 try debug test cpp_gtest
+ Rev4 MacOSX Snow Leopard 10.6 try opt test cpp_gtest
+ Rev5 MacOSX Mountain Lion 10.8 try debug test cpp_gtest
+ Rev5 MacOSX Mountain Lion 10.8 try opt test cpp_gtest
+ Rev5 MacOSX Yosemite 10.10 try debug test cpp_gtest
+ Rev5 MacOSX Yosemite 10.10 try opt test cpp_gtest
+ Ubuntu ASAN VM 12.04 x64 try opt test cpp_gtest
+ Ubuntu Code Coverage VM 12.04 x64 try opt test cpp_gtest
+ Ubuntu VM 12.04 try debug test cpp_gtest
+ Ubuntu VM 12.04 try opt test cpp_gtest
+ Ubuntu VM 12.04 try pgo test cpp_gtest
+ Ubuntu VM 12.04 x64 try debug test cpp_gtest
+ Ubuntu VM 12.04 x64 try opt test cpp_gtest
+ Ubuntu VM 12.04 x64 try pgo test cpp_gtest
+ Windows 7 32-bit try debug test cpp_gtest
+ Windows 7 32-bit try opt test cpp_gtest
+ Windows 7 32-bit try pgo test cpp_gtest
+ Windows 8 64-bit try debug test cpp_gtest
+ Windows 8 64-bit try opt test cpp_gtest
+ Windows 8 64-bit try pgo test cpp_gtest
+ Windows XP 32-bit try debug test cpp_gtest
+ Windows XP 32-bit try opt test cpp_gtest
+ Windows XP 32-bit try pgo test cpp_gtest
Comment 4 User image Chris Manchester (:chmanchester) 2015-07-02 15:30:33 PDT
Created attachment 8629113 [details] [diff] [review]
Turn on gtest job on try

I'd like to turn these on so I can test a new job on try (I'll keep these hidden as they won't do anything interesting until the mozharness changes land). Let me know if this plan makes sense, or we'd be better of starting on a project branch.
Comment 5 User image Ted Mielczarek [:ted.mielczarek] 2015-07-02 17:39:20 PDT
(In reply to Benoit Girard (:BenWa) from comment #1)
> What's the full runtime for GTest these days? When I added it the overhead
> of doing a job for it would of been much much higher than just running it in
> the build phase.

There's another benefit to splitting it to its own test job--if it fails, sheriffs can retrigger it without having to retrigger a whole build.
Comment 6 User image Benoit Girard (:BenWa) 2015-07-02 17:45:45 PDT
Good point
Comment 7 User image Chris Manchester (:chmanchester) 2015-07-14 12:03:51 PDT
https://hg.mozilla.org/build/buildbot-configs/rev/5dba1e4ab159
Comment 8 User image Ben Hearsum (:bhearsum) 2015-07-15 08:09:27 PDT
In production: https://hg.mozilla.org/build/buildbot-configs/rev/5dba1e4ab159
Comment 9 User image Ben Hearsum (:bhearsum) 2015-07-15 08:12:28 PDT
In production: https://hg.mozilla.org/build/buildbot-configs/rev/5dba1e4ab159
Comment 10 User image Chris Manchester (:chmanchester) 2015-07-17 17:00:04 PDT
Cpp-G is showing up on try now, I can work from there.

Note You need to log in before you can comment on or make changes to this bug.