Closed Bug 1651424 Opened 4 years ago Closed 4 years ago

Gather build telemetry using Glean

Categories

(Firefox Build System :: General, task)

task

Tracking

(firefox80 wontfix, firefox81 wontfix, firefox82 fixed)

RESOLVED FIXED
mozilla80
Tracking Status
firefox80 --- wontfix
firefox81 --- wontfix
firefox82 --- fixed

People

(Reporter: mhentges, Assigned: mhentges)

References

(Blocks 2 open bugs)

Details

Attachments

(4 files)

Rather than using hand-rolled telemetry, we want to piggyback off of the good work of the glean folks.

Note that glean requires Python 3, so this will remove our visibility into mach invocations for Python 2 commands, like ./mach test.

Assignee: nobody → mhentges

As discussed with Ricky, this ticket won't include the deprecation of the old build telemetry, but rather this telemetry will be gathered in addition to the existing system.

See Also: → 1651483

Installs glean to the currently-active python installation during bootstrap, whether
that be a virtualenv or the system instance of python.

Summary: Migrate build telemetry to use Glean → Gather build telemetry using Glean

In addition to the existing build telemetry, also gather the stats and
report with Glean. This new telemetry is reported in tandem with the existing
telemetry to allow testing and confidence before a full roll-out.

Additionally, Glean isn't compatible with Python 2, so the new telemetry only runs
on Python 3 mach commands.

Depends on D83012

Attachment #9162654 - Attachment description: Bug 1651424: Install glean in bootstrap r?rstewart → Bug 1651424: Install glean in bootstrap
Pushed by mhentges@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/cc6516a63bb5
Install glean in bootstrap r=firefox-build-system-reviewers,rstewart
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla80

Glean is now installed, but we still need to report the data - more work to do yet!

Status: RESOLVED → REOPENED
Resolution: FIXED → ---
See Also: → 1654052
See Also: → 1654070
Depends on: 1654070
See Also: 1654070
Blocks: 1654082

Improves glean performance.
Prior to this change, using Glean adds ~500ms to each mach run.
After this change, using Glean adds ~200ms to each mach run.

Pushed by mhentges@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/398eb90cd742
Bump glean version to 32.3.0 r=firefox-build-system-reviewers,rstewart
Depends on: 1662130

Depending on 1662130 so that try runs aren't clouded with unrelated test failures.

Status: REOPENED → RESOLVED
Closed: 4 years ago4 years ago
Resolution: --- → FIXED
Status: RESOLVED → REOPENED
Keywords: leave-open
Resolution: FIXED → ---

Since the status are different for nightly and release, what's the status for beta?
For more information, please visit auto_nag documentation.

Regressions: 1662899

32.3.0 was missing Python wheels for macOS.

Pushed by mhentges@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/6170aee18eb4
Bump glean version to 32.3.1 r=firefox-build-system-reviewers,rstewart
Pushed by mhentges@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/5ecacfbe4d0d
Report build telemetry using Glean r=firefox-build-system-reviewers,Dexter,rstewart

Telemetry is being gathered with glean.
Though there's follow-up work, this is complete.

Status: REOPENED → RESOLVED
Closed: 4 years ago4 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: