927061 - [tracker] Make taskcluster mac debug builds Tier-1

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Description

[Hal Wine [:hwine] use NI!]

bug 921040 will determine if this is both possible and a reasonable thing to do. This bug will track all the related issues about getting it successfully deployed in production

Comment 1

[Hal Wine [:hwine] use NI!]

Status update for tracked bugs:

Looking Good:
 - bug 921040 has a Mac build (with caveats), 
   - path to a full build seems likely
   - engaging QA to sanity check build performance on multiple OSX versions

Still much too do before decision made:
 - tooling for packaging is still an unknown (new dependent bug coming)
 - which portions of packaging and other non-compile work can be shifted to linux
 - if other mac operations can be moved (updaters, l10n repacks)

Comment 2

[Hal Wine [:hwine] use NI!]

> Status update for tracked bugs:
> 
> Looking Good:
>  - bug 921040 has a Mac build (with caveats),

2 caveats (webrtc & ICU) appear well in hand (patches ready to land)

Symbol support for crash reporter may be an issue, may not be possible
at first (bug 921040 comment 114). Worst case will need to do on inhouse
hardware.

>    - path to a full build seems likely
>    - engaging QA to sanity check build performance on multiple OSX versions

QA Results still pending. Performance will only be an approximation, as
talos tests currently not working natively on mac (bug 935997).

>  - tooling for packaging is still an unknown (new dependent bug coming)

Bug 935237 has the latest. We can do it, however current image is about
2x the size of native due to compression. Still investigating where
compression is being done, and if we can reproduce on linux.

> Still much too do before decision made:
>  - which portions of packaging and other non-compile work can be shifted to
> linux
>  - if other mac operations can be moved (updaters, l10n repacks)

This work currently blocked by basic packaging work above. Will
re-evaluate after solutions there are found.

Comment 3

[Hal Wine [:hwine] use NI!]

(In reply to Hal Wine [:hwine] (use needinfo) from comment #2)
> > Status update for tracked bugs:
> 
> QA Results still pending. Performance will only be an approximation, as
> talos tests currently not working natively on mac (bug 935997).

QA test results are in, two issues need dev investigation:
 1. "Geolocation position is: Position acquisition timed out" occurs
    on all OS versions.
 2. Severe increased memory usage on tests using SWF.

Comment 4

[Hal Wine [:hwine] use NI!]

(In reply to Hal Wine [:hwine] (use needinfo) from comment #3)
> QA test results are in, two issues need dev investigation:
>  1. "Geolocation position is: Position acquisition timed out" occurs
>     on all OS versions.

This is bug 935451, so not unique to the cross compile builds. Whew!

Comment 5

[Hal Wine [:hwine] use NI!]

status update:
 - compile/link issues resolved -- awaiting landings
 - QA testing via mozmill shows no differences from 25.0.1 on any of 10.6, 10.7, 10.8, or 10.9
 - packaging work ongoing
 - initial integration into build farm whiteboarded, bugs to be filed

Comment 6

[(not currently active) Ted Mielczarek]

(In reply to Hal Wine [:hwine] (use NI) from comment #0)
> bug 921040 will determine if this is both possible and a reasonable thing to
> do. This bug will track all the related issues about getting it successfully
> deployed in production

That bug is all-but-done, so I'm going to try to make sure I have all the deps marked here so we can track "turn off the buildbot Mac builds in favor of the Taskcluster cross-mac builds" in this bug.

Comment 7

[(not currently active) Ted Mielczarek]

We'll need to fix bug 992323 in order to not lose test coverage--the cross-builds don't run `make check`.

Comment 8

[(not currently active) Ted Mielczarek]

The cross-mac builds are using a newer clang than the existing mac builds, we should fix that (by updating clang on the existing mac builds) so we're comparing apples to apples.

Comment 9

[Dustin J. Mitchell [:dustin] (he/him)]

Is there anything remaining to do here?  The universal builds work is captured elsewhere (bug 1183613).

Comment 10

[(not currently active) Ted Mielczarek]

If we don't fix bug 992323 we'll lose test coverage of whatever's in `make check` right now because we can't run that in a cross-compile scenario.

Comment 11

[(not currently active) Ted Mielczarek]

Also: I don't know if bug 1184122 still blocks this--we don't currently have any test jobs running off of the TC mac build jobs. We had talked about standing them up by using the buildbot Mac testers, but if that's not the current plan then you can close that bug.

Comment 12

[Dustin J. Mitchell [:dustin] (he/him)]

OK, those are both important, and noted.  I'm still not sure what *this* bug represents, or is tracking..

Comment 13

[Chris Cooper [:coop] (he/him)]

I'm scoping this bug specifically to cover debug builds at tier 1.

Opt builds and nightlies are covered by bug 1267425.

Comment 14

[(not currently active) Ted Mielczarek]

bug 1360964 made this change.