automation tier start message buffered by make

RESOLVED FIXED in Firefox 42

Status

()

Core
Build Config
RESOLVED FIXED
3 years ago
2 years ago

People

(Reporter: mshal, Assigned: mshal)

Tracking

unspecified
mozilla42
Points:
---

Firefox Tracking Flags

(firefox42 fixed)

Details

Attachments

(2 attachments)

(Assignee)

Description

3 years ago
On windows where we enable output buffering, the TIER_START message is buffered by make along with the rest of the output for each automation step. So for example, buildsymbols will run for several minutes, then make prints the tier start + all buildsymbols output + tier finish all at once. As far as mach knows, the buildsymbols step only ran for the time it took to print the output, which means its stat tracking is inaccurate.
(Assignee)

Updated

3 years ago
Blocks: 1159832
(Assignee)

Comment 1

3 years ago
Created attachment 8624201 [details] [diff] [review]
0001-Bug-1175895-aid-greppability-of-MOZ_AUTOMATION_.patch

This just aids the greppability of MOZ_AUTOMATION_* - for example, looking up MOZ_AUTOMATION_UPDATE_PACKAGING in dxr would have you believe that it's only used for partial updates, but moz-automation.mk also uses it for complete mar generation.
Attachment #8624201 - Flags: review?(ted)
(Assignee)

Comment 2

3 years ago
Created attachment 8624202 [details] [diff] [review]
0002-Bug-1175895-separate-tier-start-message-for-mach.patch

Separate the tier start message into a different target. This forces make to flush it to stdout before the automation step starts running, so mach can get accurate stats.
Attachment #8624202 - Flags: review?(ted)
Comment on attachment 8624201 [details] [diff] [review]
0001-Bug-1175895-aid-greppability-of-MOZ_AUTOMATION_.patch

Review of attachment 8624201 [details] [diff] [review]:
-----------------------------------------------------------------

::: build/moz-automation.mk
@@ +55,5 @@
> +  MOZ_AUTOMATION_PRETTY_UPDATE_PACKAGING \
> +  MOZ_AUTOMATION_L10N_CHECK \
> +  MOZ_AUTOMATION_PRETTY_L10N_CHECK \
> +  MOZ_AUTOMATION_UPLOAD \
> +  MOZ_AUTOMATION_SDK \

You could alternately just wrap this whole block in an `$(addprefix MOZ_AUTOMATION_,`, but gnu make is terrible so whatever.
Attachment #8624201 - Flags: review?(ted) → review+
Attachment #8624202 - Flags: review?(ted) → review+

Comment 4

2 years ago
https://hg.mozilla.org/integration/mozilla-inbound/rev/77d5a7ca90c5
https://hg.mozilla.org/integration/mozilla-inbound/rev/c28f6bfc72c1
https://hg.mozilla.org/mozilla-central/rev/77d5a7ca90c5
https://hg.mozilla.org/mozilla-central/rev/c28f6bfc72c1
Status: NEW → RESOLVED
Last Resolved: 2 years ago
status-firefox42: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla42
You need to log in before you can comment on or make changes to this bug.