946828 - Investigate build and test infrastructure

Status: VERIFIED FIXED

(Socorro :: General, task)

Description

[Lonnen :lonnen]

Look into the build and test infrastructure to get some metrics about what time is spent where, then eliminate redundant or unnecessary work.

Comment 1

[[github robot]]

Commits pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/4706f074774eb0940cd0d49c5c656c72248d4ee0
bug 946828 - remove unix `time` calls from the Make process

https://github.com/mozilla/socorro/commit/a98b68c81caafc8d5e4d5e083d340e7dbc92d1ad
Merge pull request #1724 from lonnen/946828-timing-improvements

bug 946828 - remove unix `time` calls from the Make process

Comment 2

[Lonnen :lonnen]

Building an analysis in a gist: https://gist.github.com/lonnen/7896960

highlights so far:

"Since we're making several independent calls to make, and using .PHONY targets that don't identify filesystem artifacts, we end up running some make targets multiple times."

"At a glance the three places we spend most of the time in a build are:

05:00 non-webapp socorro unittests
01:00 webapp-django dependency installation (00:30 x 2)
00:25 integration test database setup"

Comment 3

[Lonnen :lonnen]

Targeted for 69 because some changes made it into this release. It's not 'fixed', but further fixes will get this re-targeted when they lands.

Comment 4

[[github robot]]

Commit pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/bed8bcbce122b9a54d4a99bd5a81bee97e32cdd1
bug 946828 - remove duplicate entry in makefile

Comment 5

[Lonnen :lonnen]

This is getting untenable. I'm resolving this because of the stuff that has already landed and filing a tracker to split this as best I can into incremental improvements.

Comment 6

[Matt Brandt [:mbrandt]]

Bumping to verified .. thanks for continuing to work on making this a reality