1390517 - Speed up the Travis run

Status: RESOLVED FIXED

(Tree Management :: Treeherder, enhancement, P2)

Description

[Ed Morley [:emorley]]

Currently the Travis run takes anywhere from 8 to 15 minutes (wall time) to complete.

This is both tedious when authoring and reviewing PRs, and also slows down Heroku deploys (since they don't start until the Travis run has declared itself as passing).

Comment 1

[GitHub Autolander Bot]

Attachment: [treeherder] mozilla:faster-travis > mozilla:master

Comment 2

[Treeherder GitHub Bugbot]

Commits pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/f76ae07b975728589e542876d5a8b644f552c2cc
Bug 1390517 - Travis: Remove redundant upgrade of pip

Since the pre-installed version of pip has now been updated to 9.0.1
already.

https://github.com/mozilla/treeherder/commit/cc490c85ee8c132a6c443003c1b68a6233d10641
Bug 1390517 - Travis: Remove sleep after starting xvfb

Since the yarn build takes so long that xvfb already has plenty of
time to start before the tests are run.

https://github.com/mozilla/treeherder/commit/ca8f46c23ed8a282101d283302f26729aa502de3
Bug 1390517 - Travis: Switch the JS job to the GCE infrastructure

Whilst the sudo-less EC2 container builds have a faster boot time than
the fully virtualised GCE jobs (1s vs 20-30s), they have less CPU/RAM
available due to resource contention, so are slower than GCE for
longer running jobs.

Switching roughly halves the runtime of this job.

https://github.com/mozilla/treeherder/commit/e66210f691944270bf9287c0b305070c7e3562b2
Bug 1390517 - Travis: Make the selenium job cache node_modules too

Previously the selenium job was spending 20 seconds in `yarn install`.

https://github.com/mozilla/treeherder/commit/64099faa727ea0ef9c72280037d12c1626e3dd67
Bug 1390517 - Travis: Switch to the edge (latest) Trusty image

Travis occasionally update the stable release Trusty image, however
not as often as would be ideal. The newer images now have recent
yarn pre-installed, meaning the manual install steps can be removed.
In addition, the `$HOME/bin` directory now exists by default in the
image.

https://github.com/mozilla/treeherder/commit/ea4440d817fa28034721722b4e885c09c5744711
Bug 1390517 - Travis: Reduce duplication in .travis.yml

All but one of the jobs is using `sudo: required`, so it makes more
sense to set it globally, and override on just that one job.

https://github.com/mozilla/treeherder/commit/65abca3fbaca3b391f106dbf9e93da797a20cfa6
Bug 1390517 - Travis: Rebalance Python test job chunks

The split of test directories between each Python chunk has been
adjusted to more evenly balance runtime. The `tests/e2e` directory
has been moved from chunk B to chunk A, and the `tests/webapp/embed`
+ `tests/webapp/graphql` directories from chunk C to chunk A.

Short of moving tests in the `tests/webapp/api` directory around,
this is the best we can do for now. Hopefully bug 1348947 can
improve the situation in the future.