1635260 - glean_parser should generate Rust APIs for metrics in Project FOG

Status: RESOLVED FIXED

(Toolkit :: Telemetry, task, P1)

Description

[Chris H-C :chutten]

• Invoke glean_parser as part of the build
  • Where will the generated code live?
  • Where will we expect metrics.yaml(s) to live? (document it)
• Use glean_parser-generated APIs to measure some aspect of Project FOG (perhaps how many metrics are registered? (how very meta))
• User documentation beyond "where to put your metrics.yaml" might just be a link to the Book of Glean since we don't presently plan any augmentations to the basic structure.
• Have a conversation with Data Platform about how many metrics.yaml is too many.

Comment 1

[Chris H-C :chutten]

A request from SpiderMonkey is that we consider checking in the glean_parser-generated files. This will allow builds that don't change anything from requiring glean_parser. This in turn supports "auto-bisection of fuzzing", as well as allowing for simpler non-Mozilla embedding (like in GNOME).

Comment 2

[Alessio Placitelli [:Dexter]]

(In reply to Chris H-C :chutten from comment #1)

This will allow builds that don't change anything from requiring glean_parser.

What do you mean here?

This in turn supports "auto-bisection of fuzzing", as well as allowing for simpler non-Mozilla embedding (like in GNOME).

What's auto-bisection of fuzzing?
Can you expand a bit more on non-Mozilla embedding? What's the current use-case?

I'm interested because maybe there's things we can fix generally in the SDK itself.

Comment 3

[Chris H-C :chutten]

(In reply to Alessio Placitelli [:Dexter] from comment #2)

What do you mean here?

GNOME embeds SpiderMonkey as GJS. SpiderMonkey has some Telemetry in it that GNOME doesn't even build. To build a cutout so that instrumentation APIs can be present even if there's no toolkit/components/telemetry in the build, JS does some redirection (:mgaudet mentions "https://searchfox.org/mozilla-central/source/js/src/gc/Statistics.cpp#1107 -> https://searchfox.org/mozilla-central/source/js/src/vm/Runtime.cpp#315-319 which pipes all the way over to here https://searchfox.org/mozilla-central/source/js/xpconnect/src/XPCJSRuntime.cpp#2586")

On top of this redirection we assume external consumers like GNOME wouldn't be best pleased if they had to pull in glean_parser to generate data collection APIs for a feature they didn't even want. It wouldn't be the worst thing to ask of them, but politics.

:tcampbell asked on the FOG C++ API Design Proposal if we could help support this usecase by checking in the generated API. This will reduce the cognitive load of supporting non-Mozilla consumers to "just" providing no-op metric type implementations and remove the need for redirection, and apparently support some fuzzing usecase that I don't understand very well.

Comment 4

[Alessio Placitelli [:Dexter]]

(In reply to Chris H-C :chutten from comment #3)

(In reply to Alessio Placitelli [:Dexter] from comment #2)

What do you mean here?

GNOME embeds SpiderMonkey as GJS. SpiderMonkey has some Telemetry in it that GNOME doesn't even build. To build a cutout so that instrumentation APIs can be present even if there's no toolkit/components/telemetry in the build, JS does some redirection (:mgaudet mentions "https://searchfox.org/mozilla-central/source/js/src/gc/Statistics.cpp#1107 -> https://searchfox.org/mozilla-central/source/js/src/vm/Runtime.cpp#315-319 which pipes all the way over to here https://searchfox.org/mozilla-central/source/js/xpconnect/src/XPCJSRuntime.cpp#2586")

I think that having that abstraction layer in between would be the best way... not the problem is understanding whether the abstraction needs to live in the Firefox Telemetry component or the JS component. We were considering creating a no-op version of Glean, but I don't think it would be of much help in this case.

On top of this redirection we assume external consumers like GNOME wouldn't be best pleased if they had to pull in glean_parser to generate data collection APIs for a feature they didn't even want. It wouldn't be the worst thing to ask of them, but politics.

That pretty much depends on how the integration is done. What are the steps to integrate/embed in third parties? Where is that documented? Who can know about that?

For example, if GNOME pulls m-c, then glean_parser is there already, so no additional effort.

:tcampbell asked on the FOG C++ API Design Proposal if we could help support this usecase by checking in the generated API. This will reduce the cognitive load of supporting non-Mozilla consumers to "just" providing no-op metric type implementations and remove the need for redirection, and apparently support some fuzzing usecase that I don't understand very well.

Leaving aside the fuzzing usecase (I'd be interested in knowing more!), how many non-Mozilla consumers do we have? The effort to provide "no-op" metric type is non-trivial, as it basically means supporting "another platform". For this specific use-case, wouldn't it make sense to compile-time conditionally exclude telemetry?

I mean, given the number of metrics, it seems like conditionally excluding might be the most convenient option

Comment 5

[Chris H-C :chutten]

Alas I've reached the end of my understanding of the problem set.

Comment 6

[Ted Campbell [:tcampbell]]

• Standalone SpiderMonkey builds. This is a critical workflow for the team. This build pulls in mozglue and mbft but otherwise doesn't include the rest of gecko. If the generated glean code is straightforward, it would be nice for these standalone builds to compile against it.

• Fuzzing usecase: The concern here is build time impact to spidermonkey shell. When the fuzzers find a bug, they often bisect the hg history and build shells (often with custom flags). A slowed down build (eg, because of a complex rust tool being built from source to generate header files) would just slow this down and add to costs. This probably a minor concern if glean/fog is reasonably quick (or at least plays nice with sccache). While spidermonkey does have generated-file steps as part of it's build, they are generally all simple python scripts that are very fast.

• For GNOME embedding. The config seems to be here. They take our spidermonkey package tarballs which are a subset of m-c. If glean_parser is already vendored we could easily have it in the tarball. There has been some resistance to building rust, but Rust is growing less optional in spidermonkey so I don't think this is an issue.

• There are only a handful of non-mozilla consumers and they generally are all playing catch-up to ESR-68 these days. It doesn't make sense to invest a lot of effort to just fix these cases though.

Looking at the FOG C++API doc, I see examples like TimingDistribution as helper types. Is it expected that we'd generally migrate probes to more standard definitions? Without a no-op cutout, it seems hard to ever move from our current uses of simple u32 sample reporting. The hope would be that telemetry is a more useful tool for spidermonkey, but managing these layers of shims and restricting to very simple samples continues to hinder that. We do always have the option of using our own python script to parse the glean config with minimal support to generate the cutout spidermonkey would need, but that seems counterproductive.

I was curious how WebRender handles this because they build a non-browser testing harness (wrench), but I can't seem to find any mention of telemetry in gfx/wr. It still seems like there is a challenge of collecting telemetry when components are more modular, but perhaps I am misunderstanding the aim of this FOG project.

Comment 7

[Chris H-C :chutten]

Hoo, there's a lot to unpack here.

(In reply to Ted Campbell [:tcampbell] from comment #6)

• Standalone SpiderMonkey builds. This is a critical workflow for the team. This build pulls in mozglue and mbft but otherwise doesn't include the rest of gecko. If the generated glean code is straightforward, it would be nice for these standalone builds to compile against it.

Hrm. It's unclear at this juncture exactly where these generated headers would live but it is more than likely that they'll be in toolkit/. Certainly the Metric Types themselves (like TimingDistribution) will live in toolkit/components/glean). I guess this means it doesn't matter if we check in generated headers or not: the cutout has to happen inside SpiderMonkey itself.

Looks like we'll have to address this as a special case, then, as no solution we put in the Glean SDK or the FOG layer will be able to help you out with this. We live too far outside the problem.

The Glean SDK is used to living with components, though, so there will be some things we can help with. Maybe we give SpiderMonkey its own metrics.yaml (already supported) and generate its C++ headers inside SpiderMonkey itself where they can be committed to the tree. SpiderMonkey would then be responsible for maintaining a nooping set of metric type implementations, but only the ones that they themselves use, and including them in exactly the build configurations they need to.

But for now I think we can go ahead without building anything special for this case. It can wait for Migration (in 2021).

• Fuzzing usecase: The concern here is build time impact to spidermonkey shell...
• For GNOME embedding. ... There has been some resistance to building rust, but Rust is growing less optional in spidermonkey so I don't think this is an issue

Oh, well then I have good news! glean_parser is a python package. You can get it from pypi if you want, or use the one vendored in mozilla-central. It's very quick to run.

Looking at the FOG C++API doc, I see examples like TimingDistribution as helper types. Is it expected that we'd generally migrate probes to more standard definitions? Without a no-op cutout, it seems hard to ever move from our current uses of simple u32 sample reporting. The hope would be that telemetry is a more useful tool for spidermonkey, but managing these layers of shims and restricting to very simple samples continues to hinder that. We do always have the option of using our own python script to parse the glean config with minimal support to generate the cutout spidermonkey would need, but that seems counterproductive.

There are a few things here that I might be able to help with. The first is: please continue putting your C++ API feedback into the doc. That's where I'll look for it : )

Next, TimingDistribution is the C++ representation of the Timing Distribution metric type. In Firefox Telemetry it'd be an exponential histogram with a name that ends in _MS.

Also, Migration will be a separate stage in this process. Project FOG is about getting the Glean SDK into Firefox Desktop to a point where we can stop adding new Telemetry probes and start adding them as Glean metrics instead. Migrating all the Firefox Telemetry probes to Glean metrics is a Whole Other Thing that will be kicked off in H2 and won't start happening until 2021. We have a ways to go yet.

In our next Project FOG Milestone we'll be looking into all the things Telemetry supports and how Project FOG does or will need to support them. :tcampbell, would you be a good person to reach out to at that time (mid-June-ish) about SpiderMonkey's needs? I get the feeling that there's a lot we'll be able to do for you, but we'll need to have a meeting or something to figure out exactly how.

Comment 8

[Ted Campbell [:tcampbell]]

(sorry, tone of my message was a little off if my previous reply).

Thanks for the info, this is quite helpful and sounds like there are some reasonable paths forward.

Being able to have a SpiderMonkey metrics.yaml and using the python parser will probably go a long way for our needs.

Having things like TimingDistribution inside mfbt would be ideal, but you are right that SpiderMonkey could have straightforward cutouts for some of those. Conceivably, these dummy distribution types could still be in toolkit/components/glean. Standalone spidermonkey builds are able to use the occasional file from toolkit/.

Happy to chat in the future about this.

Comment 9

[Chris H-C :chutten]

Attachment: Bug 1635260 - Playing with a Rust external template for glean_parser

If you run it inside its dir with
python3 run_glean_parser.py ./metrics.yaml .
then it generates files that almost look correct.

This isn't enough to check in (no tests, missing half of the functionality)
but it is enough for me or others to build on.

Comment 10

[Lina Butler [:lina]]

Oh, this is very cool! 👀

Comment 11

[Chris H-C :chutten]

Looks like we're not the first to do this (run moz.build-triggered Python to generate Rust). An example that is particularly similar to what we're attempting here would be the transformation of StaticPrefList.yaml to static_prefs.rs(moz.build, python)

Thanks to :nika for the tip.

Comment 12

[Chris H-C :chutten]

Attachment: Bug 1635260 - Use glean_parser to generate a Rust API r?janerik!

Work in progress.

I'm generating it to a single-file module called da_metrics.rs because the
module glean::metrics is already taken. We're gonna have to move things
around or come up with a different design.

The template doesn't yet handle anything but the simplest metrics (no pings,
no labeled, no giant MetricsID tables).

Naming of files, folders, and modules all up for bikeshedding. Have at them.

Comment 13

[Chris H-C :chutten]

Metrics and pings now supported in the patch, but attempts to get autodocs generated so that Sphinx can add them under https://firefox-source-docs.mozilla.org/toolkit/components/glean/index.html someplace have fallen flat. I'm gonna spin that task out to its own bug for clarity's sake.

Other thoughts at this point in the bug:

• Can we make the metric type ctors crate-internal? Generating the metrics/pings like this makes it so that they'll be able to reach it, but if we could forbid the creation of metrics/pings outside of FOG that'd be ideal.
• Generating the metrics/pings like this (to single-file mods inside the api crate) means that moz.build inside FOG needs to know the locations of all metrics.yaml and pings.yaml across the codebase. May influence bug 1651107
• Building all this with cutouts is a bit of a pain. It'll be worth it to streamline moving this all back in-repo to enable other non-FOG Rust consumers... but blarg.

Comment 14

[Chris H-C :chutten]

Attachment: Bug 1635260 - Update vendored glean_parser to 1.28.0 r?janerik!

Using ./mach vendor python glean_parser==1.28.0

(this is the latest version)

Comment 15

[Chris H-C :chutten]

Attachment: Bug 1635260 - Add a simple regression test for Rust glean_parser generation r?janerik!

Depends on D84005

Comment 16

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/910206969054
Update vendored glean_parser to 1.28.0 r=janerik
https://hg.mozilla.org/integration/autoland/rev/ae1ead062088
Use glean_parser to generate a Rust API r=janerik
https://hg.mozilla.org/integration/autoland/rev/69ac6ae983c7
Add a simple regression test for Rust glean_parser generation r=janerik

Comment 17

[Noemi Erli[:noemi_erli]]

Backed out 3 changesets (Bug 1635260) for causing build bustages CLOSED TREE

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&selectedTaskRun=WPozI8YISW6v_HVZmg04iQ.0&resultStatus=testfailed%2Cbusted%2Cexception&revision=69ac6ae983c77191f51b6c0700aa89460f5ebe68

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=310994548&repo=autoland&lineNumber=1477

Backout: https://hg.mozilla.org/integration/autoland/rev/f57feac79a9db47a34e46b62967bd95a982754eb

Comment 18

[Chris H-C :chutten]

Oh, poo. Sorry about that. Let me fix that up real quick.

Comment 19

[Chris H-C :chutten]

Attachment: Bug 1635260 - mozbuild needs at least an empty file to build r?TravisLong!

Depends on D84747

Comment 20

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/62dd07b3dcda
Update vendored glean_parser to 1.28.0 r=janerik
https://hg.mozilla.org/integration/autoland/rev/320c91b98262
Use glean_parser to generate a Rust API r=janerik
https://hg.mozilla.org/integration/autoland/rev/71095f700b94
Add a simple regression test for Rust glean_parser generation r=janerik
https://hg.mozilla.org/integration/autoland/rev/40fca1886746
mozbuild needs at least an empty file to build r=TravisLong

Comment 21

[Narcis Beleuzu [:NarcisB]]

Backed out for bustages on metrics.yaml

Backout link: https://hg.mozilla.org/integration/autoland/rev/0ae4f6d05bc52117a58b6f158584b3a6e2dd01cb
Log link: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=311187937&repo=autoland&lineNumber=1878

Comment 22

[Chris H-C :chutten]

That's exceedingly strange, I pushed to try and it built just fine: https://treeherder.mozilla.org/#/jobs?repo=try&revision=2999c241dac513d847320be297bd6e04d08c7b29

Looking into this.

Comment 23

[Chris H-C :chutten]

Ah. bug 1654663 broke this by removing glean_parser from being able to be imported by build scripts. Time to work around that.

Comment 24

[Chris H-C :chutten]

Attachment: Bug 1635260 - Scope the import of glean_parser r?janerik!

glean_parser is being used by mach to send build telemetry and by FOG to
generate APIs. We have to keep them separate somehow.

Depends on D84862

Comment 25

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ca3d0c1ab2f0
Update vendored glean_parser to 1.28.0 r=janerik
https://hg.mozilla.org/integration/autoland/rev/26841b57b728
Use glean_parser to generate a Rust API r=janerik
https://hg.mozilla.org/integration/autoland/rev/e4043a8d0eda
Add a simple regression test for Rust glean_parser generation r=janerik
https://hg.mozilla.org/integration/autoland/rev/28491a3bf64b
mozbuild needs at least an empty file to build r=TravisLong
https://hg.mozilla.org/integration/autoland/rev/045709622337
Scope the import of glean_parser r=janerik

Comment 26

[Bogdan Tara[:bogdan_tara | bogdant]]

Backed out 5 changesets (bug 1635260) for glean related bustages

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&selectedTaskRun=d_MZL_wxSpidI7QDRuyG8Q.0&searchStr=build&fromchange=51d62a946a2449ee617cf72a97214a59a858a351&tochange=2f73317f898381492f377bf0c50b187fb064f6ba

Backout link: https://hg.mozilla.org/integration/autoland/rev/2f73317f898381492f377bf0c50b187fb064f6ba

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=311282472&repo=autoland&lineNumber=12983

[task 2020-07-28T16:11:22.314Z] 16:11:22     INFO -  [style 0.0.1] cargo:rerun-if-changed=properties/build.py
[task 2020-07-28T16:11:22.316Z] 16:11:22     INFO -       Running `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name datetime --edition=2018 toolkit/components/glean/api/tests/datetime.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=71127b213ba3d9b4 -C extra-filename=-71127b213ba3d9b4 --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out`
[task 2020-07-28T16:11:22.317Z] 16:11:22     INFO -       Running `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name timespan --edition=2018 toolkit/components/glean/api/tests/timespan.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=2656024220e7ce04 -C extra-filename=-2656024220e7ce04 --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out`
[task 2020-07-28T16:11:22.319Z] 16:11:22     INFO -       Running `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name string --edition=2018 toolkit/components/glean/api/tests/string.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=682a30a5ec24b46e -C extra-filename=-682a30a5ec24b46e --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out`
[task 2020-07-28T16:11:22.321Z] 16:11:22     INFO -       Running `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name ping --edition=2018 toolkit/components/glean/api/tests/ping.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=b1574a5236918107 -C extra-filename=-b1574a5236918107 --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out`
[task 2020-07-28T16:11:22.323Z] 16:11:22     INFO -       Running `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name labeled --edition=2018 toolkit/components/glean/api/tests/labeled.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=8029e13a7056d8da -C extra-filename=-8029e13a7056d8da --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out`
[task 2020-07-28T16:11:22.325Z] 16:11:22     INFO -       Running `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name timing_distribution --edition=2018 toolkit/components/glean/api/tests/timing_distribution.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=c6a9dedeb1095d1c -C extra-filename=-c6a9dedeb1095d1c --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out`
[task 2020-07-28T16:11:22.326Z] 16:11:22     INFO -       Running `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name counter --edition=2018 toolkit/components/glean/api/tests/counter.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=374e5d157046ac1b -C extra-filename=-374e5d157046ac1b --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out`
[task 2020-07-28T16:11:22.328Z] 16:11:22     INFO -       Running `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name event --edition=2018 toolkit/components/glean/api/tests/event.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=0c69d92576269977 -C extra-filename=-0c69d92576269977 --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out`
[task 2020-07-28T16:11:22.330Z] 16:11:22     INFO -       Running `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name memory_distribution --edition=2018 toolkit/components/glean/api/tests/memory_distribution.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=765433cbf1727d1f -C extra-filename=-765433cbf1727d1f --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out`
[task 2020-07-28T16:11:22.330Z] 16:11:22    ERROR -  error[E0432]: unresolved imports `glean::metrics::CommonMetricData`, `glean::metrics::DatetimeMetric`, `glean::metrics::Lifetime`, `glean::metrics::TimeUnit`
[task 2020-07-28T16:11:22.331Z] 16:11:22     INFO -   --> toolkit/components/glean/api/tests/datetime.rs:8:22
[task 2020-07-28T16:11:22.331Z] 16:11:22     INFO -    |
[task 2020-07-28T16:11:22.331Z] 16:11:22     INFO -  8 | use glean::metrics::{CommonMetricData, DatetimeMetric, Lifetime, TimeUnit};
[task 2020-07-28T16:11:22.331Z] 16:11:22     INFO -    |                      ^^^^^^^^^^^^^^^^  ^^^^^^^^^^^^^^  ^^^^^^^^  ^^^^^^^^ no `TimeUnit` in `metrics`
[task 2020-07-28T16:11:22.331Z] 16:11:22     INFO -    |                      |                 |               |
[task 2020-07-28T16:11:22.331Z] 16:11:22     INFO -    |                      |                 |               no `Lifetime` in `metrics`
[task 2020-07-28T16:11:22.332Z] 16:11:22     INFO -    |                      |                 no `DatetimeMetric` in `metrics`
[task 2020-07-28T16:11:22.332Z] 16:11:22     INFO -    |                      no `CommonMetricData` in `metrics`
[task 2020-07-28T16:11:22.332Z] 16:11:22    ERROR -  error[E0432]: unresolved import `glean::metrics::Ping`
[task 2020-07-28T16:11:22.332Z] 16:11:22     INFO -    --> toolkit/components/glean/api/tests/ping.rs:10:5
[task 2020-07-28T16:11:22.332Z] 16:11:22     INFO -     |
[task 2020-07-28T16:11:22.332Z] 16:11:22     INFO -  10 | use glean::metrics::Ping;
[task 2020-07-28T16:11:22.332Z] 16:11:22     INFO -     |     ^^^^^^^^^^^^^^^^^^^^ no `Ping` in `metrics`
[task 2020-07-28T16:11:22.332Z] 16:11:22    ERROR -  error[E0432]: unresolved imports `glean::metrics::CommonMetricData`, `glean::metrics::Lifetime`, `glean::metrics::StringMetric`
[task 2020-07-28T16:11:22.333Z] 16:11:22     INFO -   --> toolkit/components/glean/api/tests/string.rs:9:22
[task 2020-07-28T16:11:22.333Z] 16:11:22     INFO -    |
[task 2020-07-28T16:11:22.333Z] 16:11:22     INFO -  9 | use glean::metrics::{CommonMetricData, Lifetime, StringMetric};
[task 2020-07-28T16:11:22.333Z] 16:11:22     INFO -    |                      ^^^^^^^^^^^^^^^^  ^^^^^^^^  ^^^^^^^^^^^^ no `StringMetric` in `metrics`
[task 2020-07-28T16:11:22.333Z] 16:11:22     INFO -    |                      |                 |
[task 2020-07-28T16:11:22.333Z] 16:11:22     INFO -    |                      |                 no `Lifetime` in `metrics`
[task 2020-07-28T16:11:22.334Z] 16:11:22     INFO -    |                      no `CommonMetricData` in `metrics`
[task 2020-07-28T16:11:22.334Z] 16:11:22    ERROR -  error[E0432]: unresolved imports `glean::metrics::CommonMetricData`, `glean::metrics::CounterMetric`, `glean::metrics::Lifetime`
[task 2020-07-28T16:11:22.334Z] 16:11:22     INFO -   --> toolkit/components/glean/api/tests/counter.rs:9:22
[task 2020-07-28T16:11:22.334Z] 16:11:22     INFO -    |
[task 2020-07-28T16:11:22.334Z] 16:11:22     INFO -  9 | use glean::metrics::{CommonMetricData, CounterMetric, Lifetime};
[task 2020-07-28T16:11:22.334Z] 16:11:22     INFO -    |                      ^^^^^^^^^^^^^^^^  ^^^^^^^^^^^^^  ^^^^^^^^ no `Lifetime` in `metrics`
[task 2020-07-28T16:11:22.334Z] 16:11:22     INFO -    |                      |                 |
[task 2020-07-28T16:11:22.335Z] 16:11:22     INFO -    |                      |                 no `CounterMetric` in `metrics`
[task 2020-07-28T16:11:22.335Z] 16:11:22     INFO -    |                      no `CommonMetricData` in `metrics`
[task 2020-07-28T16:11:22.335Z] 16:11:22    ERROR -  error[E0432]: unresolved imports `glean::metrics::CommonMetricData`, `glean::metrics::Lifetime`, `glean::metrics::TimeUnit`, `glean::metrics::TimespanMetric`
[task 2020-07-28T16:11:22.335Z] 16:11:22     INFO -   --> toolkit/components/glean/api/tests/timespan.rs:8:22
[task 2020-07-28T16:11:22.335Z] 16:11:22     INFO -    |
[task 2020-07-28T16:11:22.335Z] 16:11:22     INFO -  8 | use glean::metrics::{CommonMetricData, Lifetime, TimeUnit, TimespanMetric};
[task 2020-07-28T16:11:22.336Z] 16:11:22     INFO -    |                      ^^^^^^^^^^^^^^^^  ^^^^^^^^  ^^^^^^^^  ^^^^^^^^^^^^^^ no `TimespanMetric` in `metrics`
[task 2020-07-28T16:11:22.336Z] 16:11:22     INFO -    |                      |                 |         |
[task 2020-07-28T16:11:22.336Z] 16:11:22     INFO -    |                      |                 |         no `TimeUnit` in `metrics`
[task 2020-07-28T16:11:22.336Z] 16:11:22     INFO -    |                      |                 no `Lifetime` in `metrics`
[task 2020-07-28T16:11:22.336Z] 16:11:22     INFO -    |                      no `CommonMetricData` in `metrics`
[task 2020-07-28T16:11:22.336Z] 16:11:22    ERROR -  error[E0432]: unresolved imports `glean::metrics::BooleanMetric`, `glean::metrics::CommonMetricData`, `glean::metrics::CounterMetric`, `glean::metrics::ErrorType`, `glean::metrics::LabeledMetric`, `glean::metrics::Lifetime`, `glean::metrics::StringMetric`
[task 2020-07-28T16:11:22.337Z] 16:11:22     INFO -    --> toolkit/components/glean/api/tests/labeled.rs:11:5
[task 2020-07-28T16:11:22.337Z] 16:11:22     INFO -     |
[task 2020-07-28T16:11:22.337Z] 16:11:22     INFO -  11 |     BooleanMetric, CommonMetricData, CounterMetric, ErrorType, LabeledMetric, Lifetime,
[task 2020-07-28T16:11:22.337Z] 16:11:22     INFO -     |     ^^^^^^^^^^^^^  ^^^^^^^^^^^^^^^^  ^^^^^^^^^^^^^  ^^^^^^^^^  ^^^^^^^^^^^^^  ^^^^^^^^ no `Lifetime` in `metrics`
[task 2020-07-28T16:11:22.337Z] 16:11:22     INFO -     |     |              |                 |              |          |
[task 2020-07-28T16:11:22.337Z] 16:11:22     INFO -     |     |              |                 |              |          no `LabeledMetric` in `metrics`
[task 2020-07-28T16:11:22.337Z] 16:11:22     INFO -     |     |              |                 |              no `ErrorType` in `metrics`
[task 2020-07-28T16:11:22.338Z] 16:11:22     INFO -     |     |              |                 no `CounterMetric` in `metrics`
[task 2020-07-28T16:11:22.338Z] 16:11:22     INFO -     |     |              no `CommonMetricData` in `metrics`
[task 2020-07-28T16:11:22.338Z] 16:11:22     INFO -     |     no `BooleanMetric` in `metrics`
[task 2020-07-28T16:11:22.338Z] 16:11:22     INFO -  12 |     StringMetric,
[task 2020-07-28T16:11:22.338Z] 16:11:22     INFO -     |     ^^^^^^^^^^^^ no `StringMetric` in `metrics`
[task 2020-07-28T16:11:22.338Z] 16:11:22    ERROR -  error[E0432]: unresolved imports `glean::metrics::CommonMetricData`, `glean::metrics::Lifetime`, `glean::metrics::MemoryDistributionMetric`, `glean::metrics::MemoryUnit`
[task 2020-07-28T16:11:22.338Z] 16:11:22     INFO -   --> toolkit/components/glean/api/tests/memory_distribution.rs:8:22
[task 2020-07-28T16:11:22.338Z] 16:11:22     INFO -    |
[task 2020-07-28T16:11:22.339Z] 16:11:22     INFO -  8 | use glean::metrics::{CommonMetricData, Lifetime, MemoryDistributionMetric, MemoryUnit};
[task 2020-07-28T16:11:22.339Z] 16:11:22     INFO -    |                      ^^^^^^^^^^^^^^^^  ^^^^^^^^  ^^^^^^^^^^^^^^^^^^^^^^^^  ^^^^^^^^^^ no `MemoryUnit` in `metrics`
[task 2020-07-28T16:11:22.339Z] 16:11:22     INFO -    |                      |                 |         |
[task 2020-07-28T16:11:22.339Z] 16:11:22     INFO -    |                      |                 |         no `MemoryDistributionMetric` in `metrics`
[task 2020-07-28T16:11:22.339Z] 16:11:22     INFO -    |                      |                 no `Lifetime` in `metrics`
[task 2020-07-28T16:11:22.339Z] 16:11:22     INFO -    |                      no `CommonMetricData` in `metrics`
[task 2020-07-28T16:11:22.339Z] 16:11:22    ERROR -  error[E0432]: unresolved imports `glean::metrics::CommonMetricData`, `glean::metrics::EventMetric`, `glean::metrics::ExtraKeys`, `glean::metrics::Lifetime`, `glean::metrics::NoExtraKeys`
[task 2020-07-28T16:11:22.340Z] 16:11:22     INFO -    --> toolkit/components/glean/api/tests/event.rs:10:22
[task 2020-07-28T16:11:22.340Z] 16:11:22     INFO -     |
[task 2020-07-28T16:11:22.340Z] 16:11:22     INFO -  10 | use glean::metrics::{CommonMetricData, EventMetric, ExtraKeys, Lifetime, NoExtraKeys};
[task 2020-07-28T16:11:22.340Z] 16:11:22     INFO -     |                      ^^^^^^^^^^^^^^^^  ^^^^^^^^^^^  ^^^^^^^^^  ^^^^^^^^  ^^^^^^^^^^^ no `NoExtraKeys` in `metrics`
[task 2020-07-28T16:11:22.340Z] 16:11:22     INFO -     |                      |                 |            |          |
[task 2020-07-28T16:11:22.340Z] 16:11:22     INFO -     |                      |                 |            |          no `Lifetime` in `metrics`
[task 2020-07-28T16:11:22.340Z] 16:11:22     INFO -     |                      |                 |            no `ExtraKeys` in `metrics`
[task 2020-07-28T16:11:22.341Z] 16:11:22     INFO -     |                      |                 no `EventMetric` in `metrics`
[task 2020-07-28T16:11:22.341Z] 16:11:22     INFO -     |                      no `CommonMetricData` in `metrics`
[task 2020-07-28T16:11:22.341Z] 16:11:22    ERROR -  error: aborting due to previous error
[task 2020-07-28T16:11:22.341Z] 16:11:22     INFO -  For more information about this error, try `rustc --explain E0432`.
[task 2020-07-28T16:11:22.341Z] 16:11:22    ERROR -  error: aborting due to previous error
[task 2020-07-28T16:11:22.341Z] 16:11:22     INFO -  For more information about this error, try `rustc --explain E0432`.
[task 2020-07-28T16:11:22.341Z] 16:11:22    ERROR -  error: aborting due to previous error
[task 2020-07-28T16:11:22.342Z] 16:11:22     INFO -  For more information about this error, try `rustc --explain E0432`.
[task 2020-07-28T16:11:22.342Z] 16:11:22     INFO -  error: could not compile `glean`.
[task 2020-07-28T16:11:22.342Z] 16:11:22     INFO -  Caused by:
[task 2020-07-28T16:11:22.344Z] 16:11:22     INFO -    process didn't exit successfully: `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name event --edition=2018 toolkit/components/glean/api/tests/event.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=0c69d92576269977 -C extra-filename=-0c69d92576269977 --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out` (exit code: 1)
[task 2020-07-28T16:11:22.344Z] 16:11:22     INFO -  warning: build failed, waiting for other jobs to finish...
[task 2020-07-28T16:11:22.344Z] 16:11:22    ERROR -  error[E0432]: unresolved imports `glean::metrics::CommonMetricData`, `glean::metrics::Lifetime`, `glean::metrics::TimeUnit`, `glean::metrics::TimingDistributionMetric`
[task 2020-07-28T16:11:22.344Z] 16:11:22     INFO -   --> toolkit/components/glean/api/tests/timing_distribution.rs:8:22
[task 2020-07-28T16:11:22.344Z] 16:11:22     INFO -    |
[task 2020-07-28T16:11:22.344Z] 16:11:22     INFO -  8 | use glean::metrics::{CommonMetricData, Lifetime, TimeUnit, TimingDistributionMetric};
[task 2020-07-28T16:11:22.345Z] 16:11:22     INFO -    |                      ^^^^^^^^^^^^^^^^  ^^^^^^^^  ^^^^^^^^  ^^^^^^^^^^^^^^^^^^^^^^^^ no `TimingDistributionMetric` in `metrics`
[task 2020-07-28T16:11:22.345Z] 16:11:22     INFO -    |                      |                 |         |
[task 2020-07-28T16:11:22.345Z] 16:11:22     INFO -    |                      |                 |         no `TimeUnit` in `metrics`
[task 2020-07-28T16:11:22.345Z] 16:11:22     INFO -    |                      |                 no `Lifetime` in `metrics`
[task 2020-07-28T16:11:22.345Z] 16:11:22     INFO -    |                      no `CommonMetricData` in `metrics`
[task 2020-07-28T16:11:22.345Z] 16:11:22     INFO -  error: could not compile `glean`.
[task 2020-07-28T16:11:22.345Z] 16:11:22     INFO -  Caused by:
[task 2020-07-28T16:11:22.347Z] 16:11:22     INFO -    process didn't exit successfully: `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name datetime --edition=2018 toolkit/components/glean/api/tests/datetime.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=71127b213ba3d9b4 -C extra-filename=-71127b213ba3d9b4 --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out` (exit code: 1)
[task 2020-07-28T16:11:22.347Z] 16:11:22     INFO -  warning: build failed, waiting for other jobs to finish...
[task 2020-07-28T16:11:22.347Z] 16:11:22    ERROR -  error: aborting due to previous error
[task 2020-07-28T16:11:22.348Z] 16:11:22     INFO -  For more information about this error, try `rustc --explain E0432`.
[task 2020-07-28T16:11:22.348Z] 16:11:22     INFO -  error: could not compile `glean`.
[task 2020-07-28T16:11:22.348Z] 16:11:22     INFO -  Caused by:
[task 2020-07-28T16:11:22.350Z] 16:11:22     INFO -    process didn't exit successfully: `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name string --edition=2018 toolkit/components/glean/api/tests/string.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=682a30a5ec24b46e -C extra-filename=-682a30a5ec24b46e --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out` (exit code: 1)
[task 2020-07-28T16:11:22.350Z] 16:11:22     INFO -  warning: build failed, waiting for other jobs to finish...
[task 2020-07-28T16:11:22.350Z] 16:11:22     INFO -  error: could not compile `glean`.
[task 2020-07-28T16:11:22.350Z] 16:11:22     INFO -  Caused by:
[task 2020-07-28T16:11:22.352Z] 16:11:22     INFO -    process didn't exit successfully: `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name counter --edition=2018 toolkit/components/glean/api/tests/counter.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=374e5d157046ac1b -C extra-filename=-374e5d157046ac1b --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out` (exit code: 1)
[task 2020-07-28T16:11:22.352Z] 16:11:22     INFO -  warning: build failed, waiting for other jobs to finish...
[task 2020-07-28T16:11:22.352Z] 16:11:22    ERROR -  error: aborting due to previous error
[task 2020-07-28T16:11:22.352Z] 16:11:22     INFO -  For more information about this error, try `rustc --explain E0432`.
[task 2020-07-28T16:11:22.352Z] 16:11:22     INFO -  error: could not compile `glean`.
[task 2020-07-28T16:11:22.353Z] 16:11:22     INFO -  Caused by:
[task 2020-07-28T16:11:22.354Z] 16:11:22     INFO -    process didn't exit successfully: `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name timespan --edition=2018 toolkit/components/glean/api/tests/timespan.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=2656024220e7ce04 -C extra-filename=-2656024220e7ce04 --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out` (exit code: 1)
[task 2020-07-28T16:11:22.355Z] 16:11:22     INFO -  warning: build failed, waiting for other jobs to finish...
[task 2020-07-28T16:11:22.355Z] 16:11:22    ERROR -  error: aborting due to previous error
[task 2020-07-28T16:11:22.355Z] 16:11:22     INFO -  For more information about this error, try `rustc --explain E0432`.
[task 2020-07-28T16:11:22.355Z] 16:11:22     INFO -  error: could not compile `glean`.
[task 2020-07-28T16:11:22.355Z] 16:11:22     INFO -  Caused by:
[task 2020-07-28T16:11:22.357Z] 16:11:22     INFO -    process didn't exit successfully: `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name ping --edition=2018 toolkit/components/glean/api/tests/ping.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=b1574a5236918107 -C extra-filename=-b1574a5236918107 --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out` (exit code: 1)
[task 2020-07-28T16:11:22.357Z] 16:11:22     INFO -  warning: build failed, waiting for other jobs to finish...
[task 2020-07-28T16:11:22.357Z] 16:11:22    ERROR -  error: aborting due to previous error
[task 2020-07-28T16:11:22.357Z] 16:11:22     INFO -  For more information about this error, try `rustc --explain E0432`.
[task 2020-07-28T16:11:22.358Z] 16:11:22     INFO -  error: could not compile `glean`.
[task 2020-07-28T16:11:22.358Z] 16:11:22     INFO -  Caused by:
[task 2020-07-28T16:11:22.360Z] 16:11:22     INFO -    process didn't exit successfully: `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name memory_distribution --edition=2018 toolkit/components/glean/api/tests/memory_distribution.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=765433cbf1727d1f -C extra-filename=-765433cbf1727d1f --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out` (exit code: 1)
[task 2020-07-28T16:11:22.360Z] 16:11:22     INFO -  warning: build failed, waiting for other jobs to finish...
[task 2020-07-28T16:11:22.360Z] 16:11:22    ERROR -  error: aborting due to previous error
[task 2020-07-28T16:11:22.360Z] 16:11:22     INFO -  For more information about this error, try `rustc --explain E0432`.
[task 2020-07-28T16:11:22.360Z] 16:11:22     INFO -  error: could not compile `glean`.
[task 2020-07-28T16:11:22.360Z] 16:11:22     INFO -  Caused by:
[task 2020-07-28T16:11:22.362Z] 16:11:22     INFO -    process didn't exit successfully: `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name timing_distribution --edition=2018 toolkit/components/glean/api/tests/timing_distribution.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=c6a9dedeb1095d1c -C extra-filename=-c6a9dedeb1095d1c --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out` (exit code: 1)
[task 2020-07-28T16:11:22.362Z] 16:11:22     INFO -  warning: build failed, waiting for other jobs to finish...
[task 2020-07-28T16:11:22.362Z] 16:11:22    ERROR -  error: aborting due to previous error
[task 2020-07-28T16:11:22.363Z] 16:11:22     INFO -  For more information about this error, try `rustc --explain E0432`.
[task 2020-07-28T16:11:22.363Z] 16:11:22     INFO -  error: could not compile `glean`.
[task 2020-07-28T16:11:22.363Z] 16:11:22     INFO -  Caused by:
[task 2020-07-28T16:11:22.365Z] 16:11:22     INFO -    process didn't exit successfully: `CARGO=/builds/worker/fetches/rustc/bin/cargo CARGO_MANIFEST_DIR=/builds/worker/checkouts/gecko/toolkit/components/glean/api CARGO_PKG_AUTHORS='Glean SDK team <[e-mail]>' CARGO_PKG_DESCRIPTION= CARGO_PKG_HOMEPAGE= CARGO_PKG_NAME=glean CARGO_PKG_REPOSITORY= CARGO_PKG_VERSION=0.1.0 CARGO_PKG_VERSION_MAJOR=0 CARGO_PKG_VERSION_MINOR=1 CARGO_PKG_VERSION_PATCH=0 CARGO_PKG_VERSION_PRE= LD_LIBRARY_PATH='/builds/worker/workspace/obj-build/debug/deps:/builds/worker/fetches/rustc/lib:/builds/worker/workspace/obj-build/dist/bin:/builds/worker/fetches/clang/lib:/builds/worker/fetches/clang/lib32' /builds/worker/fetches/sccache/sccache /builds/worker/fetches/rustc/bin/rustc --crate-name labeled --edition=2018 toolkit/components/glean/api/tests/labeled.rs --error-format=json --json=diagnostic-rendered-ansi --emit=dep-info,link -C debuginfo=2 --test -C metadata=8029e13a7056d8da -C extra-filename=-8029e13a7056d8da --out-dir /builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps --target x86_64-unknown-linux-gnu -C linker=/builds/worker/checkouts/gecko/build/cargo-linker -L dependency=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps -L dependency=/builds/worker/workspace/obj-build/debug/deps --extern bincode=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libbincode-5db1f839ffc24b7a.rlib --extern chrono=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libchrono-6e21fd42e09e5a43.rlib --extern glean=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean-bcd85b048480276f.rlib --extern glean_core=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libglean_core-fc6a1d0d620de0ce.rlib --extern log=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/liblog-34812c6633e4a095.rlib --extern once_cell=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libonce_cell-334ddf84cd5499f5.rlib --extern serde=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libserde-61cf6dac005ccb50.rlib --extern tempfile=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libtempfile-4acaf0e06bbf17e8.rlib --extern uuid=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/deps/libuuid-014e6b42d5dcff12.rlib -C opt-level=2 -C debuginfo=2 -C force-frame-pointers=yes -Dwarnings -C codegen-units=1 -L native=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/debug/build/lmdb-rkv-sys-12329b2b55e523d6/out` (exit code: 1)
[task 2020-07-28T16:11:22.365Z] 16:11:22     INFO -  warning: build failed, waiting for other jobs to finish...
[task 2020-07-28T16:11:22.365Z] 16:11:22     INFO -  [style 0.0.1] cargo:rerun-if-changed=build_gecko.rs
[task 2020-07-28T16:11:22.365Z] 16:11:22     INFO -  [style 0.0.1] cargo:rerun-if-changed=/builds/worker/workspace/obj-build/layout/style/bindgen.toml
[task 2020-07-28T16:11:22.365Z] 16:11:22     INFO -  [style 0.0.1] cargo:rerun-if-changed=/builds/worker/checkouts/gecko/layout/style/ServoBindings.toml
...

Comment 27

[Chris H-C :chutten]

This is just embarrassing. I wrote some of those tests, and I should've known better than to push without updating them (or at least running them).

I'm gonna slow down this time so it'll stick the landing without wasting anyone else's time.

Comment 28

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/867d8e4620a4
Update vendored glean_parser to 1.28.0 r=janerik
https://hg.mozilla.org/integration/autoland/rev/532fd54ce321
Use glean_parser to generate a Rust API r=janerik
https://hg.mozilla.org/integration/autoland/rev/1a9c785369d9
Add a simple regression test for Rust glean_parser generation r=janerik
https://hg.mozilla.org/integration/autoland/rev/3f188217998d
mozbuild needs at least an empty file to build r=TravisLong

Comment 29

[Alexandru Michis [:malexandru]]

https://hg.mozilla.org/mozilla-central/rev/867d8e4620a4
https://hg.mozilla.org/mozilla-central/rev/532fd54ce321
https://hg.mozilla.org/mozilla-central/rev/1a9c785369d9
https://hg.mozilla.org/mozilla-central/rev/3f188217998d