1179955 - Turn on a GTest job in automation

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Chris Manchester (limited bugmail, email directly)]

I was able to get them running from mozharness locallly, I'd like to enable them on try (or ash, or wherever) to test my work.

Comment 1

[Benoit Girard (:BenWa)]

What's the full runtime for GTest these days? When I added it the overhead of doing a job for it would of been much much higher than just running it in the build phase.

Comment 2

[Chris Manchester (limited bugmail, email directly)]

Quickly looking at logs it's about 3 minutes, so I guess we could combine them with the Cpp job (which already finishes in under 15 minutes).

Comment 3

[Chris Manchester (limited bugmail, email directly)]

Ok, I'd like to enable a job on try that runs gtests and cppunittests in the same job while we get things up and running, then turn off the cppunittest job when these are ready to be turned on everywhere.

Builders added:
+ Rev4 MacOSX Snow Leopard 10.6 try debug test cpp_gtest
+ Rev4 MacOSX Snow Leopard 10.6 try opt test cpp_gtest
+ Rev5 MacOSX Mountain Lion 10.8 try debug test cpp_gtest
+ Rev5 MacOSX Mountain Lion 10.8 try opt test cpp_gtest
+ Rev5 MacOSX Yosemite 10.10 try debug test cpp_gtest
+ Rev5 MacOSX Yosemite 10.10 try opt test cpp_gtest
+ Ubuntu ASAN VM 12.04 x64 try opt test cpp_gtest
+ Ubuntu Code Coverage VM 12.04 x64 try opt test cpp_gtest
+ Ubuntu VM 12.04 try debug test cpp_gtest
+ Ubuntu VM 12.04 try opt test cpp_gtest
+ Ubuntu VM 12.04 try pgo test cpp_gtest
+ Ubuntu VM 12.04 x64 try debug test cpp_gtest
+ Ubuntu VM 12.04 x64 try opt test cpp_gtest
+ Ubuntu VM 12.04 x64 try pgo test cpp_gtest
+ Windows 7 32-bit try debug test cpp_gtest
+ Windows 7 32-bit try opt test cpp_gtest
+ Windows 7 32-bit try pgo test cpp_gtest
+ Windows 8 64-bit try debug test cpp_gtest
+ Windows 8 64-bit try opt test cpp_gtest
+ Windows 8 64-bit try pgo test cpp_gtest
+ Windows XP 32-bit try debug test cpp_gtest
+ Windows XP 32-bit try opt test cpp_gtest
+ Windows XP 32-bit try pgo test cpp_gtest

Comment 4

[Chris Manchester (limited bugmail, email directly)]

Attachment: Turn on gtest job on try

I'd like to turn these on so I can test a new job on try (I'll keep these hidden as they won't do anything interesting until the mozharness changes land). Let me know if this plan makes sense, or we'd be better of starting on a project branch.

Comment 5

[(not currently active) Ted Mielczarek]

(In reply to Benoit Girard (:BenWa) from comment #1)
> What's the full runtime for GTest these days? When I added it the overhead
> of doing a job for it would of been much much higher than just running it in
> the build phase.

There's another benefit to splitting it to its own test job--if it fails, sheriffs can retrigger it without having to retrigger a whole build.

Comment 6

[Benoit Girard (:BenWa)]

Good point

Comment 7

[Chris Manchester (limited bugmail, email directly)]

https://hg.mozilla.org/build/buildbot-configs/rev/5dba1e4ab159

Comment 8

[[e-mail] (:bhearsum)]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/5dba1e4ab159

Comment 9

[[e-mail] (:bhearsum)]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/5dba1e4ab159

Comment 10

[Chris Manchester (limited bugmail, email directly)]

Cpp-G is showing up on try now, I can work from there.