1773026 - undo parallel CI jobs (antenna)

Status: RESOLVED FIXED

(Socorro :: Antenna, task, P2)

Description

[Will Kahn-Greene [:willkg] ET needinfo? me]

Earlier this year, we switched from one set of images to the cimg images. When I did that, I also redid the CI configuration and broke up our monolithic job into a series of jobs. The thinking was that we could take advantage of parallelization and reduce the overall time it takes to do a CI run.

We're using a couple of CircleCI cachey things:

1. docker layer caching

• layers are kept around for some period of time
• only one executor has access to the layers so when an executor doesn't have access, it builds everything

2. workspace

• things can get saved to the workspace
• right now we're saving a docker image to the workspace and it's big so it takes a while to save and load

The end result of this is that on average, builds were faster before than they are now.

We could yak-shave the jobs. It's likely we could set up Python virtual environments and reduce the complexities of parallelization. This is a non-trivial rethink of our local dev, CI, and server environments.

Or, we could ditch parallelization and go back to a single monolithic job.

I want to do that. This bug covers that work for Antenna.

Comment 1

[Will Kahn-Greene [:willkg] ET needinfo? me]

Attachment: pr 838: bug 1773026: switch to monolithic CI job

Comment 2

[Will Kahn-Greene [:willkg] ET needinfo? me]

willkg merged PR #838: "bug 1773026: switch to monolithic CI job" in 07fb30b.

Comment 3

[Will Kahn-Greene [:willkg] ET needinfo? me]

That PR took 4 minutes. Looking at the history, it seems to range between 3 and 6 minutes or so with some outliers. This isn't a huge win, but I want to do it anyways because it keeps Antenna similar to the other projects.

Comment 4

[Will Kahn-Greene [:willkg] ET needinfo? me]

I'm pretty sure this got shipped in bug #1777242 on 6/29/2022.