905858 - Run the Jetpack test suite multiple times per-push to the Jetpack tree.

Status: RESOLVED WONTFIX

(Release Engineering :: General, defect)

Description

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

The Jetpack uplifts have been causing lots of frequent-but-intermittent test failures (bug 904063) with their recent uplifts to mozilla-central/inbound/fx-team that weren't caught prior to the uplift because the Jetpack tree doesn't have enough activity to catch them. 

While the Jetpack team appears to be getting the current failures fixed, it'd be helpful to avoid this in the future. 

If it's possible within the build/test infrastructure, it'd be nice to have each platform's version of the Jetpack test suite be automatically run multiple times to help increase the chances of us catching the new intermittent failures before we merge them to the Firefox trees, instead of having to retrigger every platform's test manually.

Comment 1

[Ed Morley [:emorley]]

For reference - opt jobs take around 10 mins, debug ~20-25. They're not run on any mobile platforms, so setup time is not overly long.