1314035 - Change FennecCI scheme to be Fennec and use FirefoxNightly scheme for BB nightly builds

Status: RESOLVED FIXED

(Firefox for iOS :: Build & Test, defect, P1)

Description

[Stephan Leroux [:sleroux]]

To better support how we produce our builds and run our UI/unit tests on BB, I propose we update the scheme as follows:

1. Remove the FennecCI scheme and simply use Fennec for on commit/merge integrations with unit testing enabled.
2. Change the nightly BB deployment to use the FirefoxNightly scheme which runs unit tests and UI tests.

This will allow us to not bog down BB with UI tests on every push and also allow us to create a FennecNoTests scheme but default to a scheme with tests enabled to allow for safer builds from contributors and streamlined builds for people who want to use the FennecNoTests scheme.

Comment 1

[Stephan Leroux [:sleroux]]

Going to pick this up while I'm working on getting 6.0 to build for beta.

Comment 2

[No-Jun Park [:njpark]]

As you can see from this list, (https://docs.google.com/spreadsheets/d/1lMPpKKSw2-cNPIxkHO0SPfi55l1HffF5Kdvxbca2wyc/edit#gid=841487504) there are tests that only passes on ipad, or iphone.  For example, DomainAutocompleteTests will fail on ipad, but passes on iphone. 
In order to run tests that only passes on certain devices, we need to create a new scheme for each of them- like FennecCI - Ipad and FennecCI - Iphone and enable applicable tests.  

But if we don't need to test older api, perhaps we can run tests on iphone only. But in that case the tests that fail on them should be disabled.

Comment 3

[Stephan Leroux [:sleroux]]

Resolved as part of https://bugzilla.mozilla.org/show_bug.cgi?id=1313147

Comment 4

[Stephan Leroux [:sleroux]]

Just saw your comment :njpark. I've landed the first pass of this bug and removed the FennecCI scheme in favor of just Fennec with tests that are currently working on iPhone. We should probably file a follow up to investigate running the test suite against both iPad and iPhone and figuring out a way to get that going with a single scheme.