1668517 - look at switching to pip-compile (socorro)

Status: RESOLVED FIXED

(Socorro :: General, task, P2)

Description

[Will Kahn-Greene [:willkg] ET needinfo? me]

The GCP Ingestion Edge uses pip-compile and a requirements.in file to manage first-order dependencies.

When they add new dependencies, they add it to requirements.in and then run pip-compile to generate a requirements.txt with hashes. They have a step in CircleCI that verifies that the requirements.txt file is up-to-date in respect to the requirements.in file. The compiled requirements.txt file has comments about what depends on what which is pretty helpful.

Socorro uses a requirements.txt file for first-order dependencies and a constraints.txt file for dependencies of dependencies. In this way, all the first-order dependencies are installed and whatever they need from the constraints file is also installed. This gets a little onerous because the constraints file grows over time and requires someone to delete and re-create it periodically to reduce it. Further, the pip devs were surprised that we use the constraints file in this way--it's not really how it was intended to be used.

This bug covers testing out a system that uses pip-compile and switching.

Comment 1

[Will Kahn-Greene [:willkg] ET needinfo? me]

Attachment: pr 5595: bug 1668517: switch to pip-compile

Comment 2

[Will Kahn-Greene [:willkg] ET needinfo? me]

willkg merged PR #5595: "bug 1668517: switch to pip-compile" in 8c3db8e.

Comment 3

[Will Kahn-Greene [:willkg] ET needinfo? me]

This went out in bug #1669777 with 2020.10.07. Marking as FIXED.