1820893 - Add nightly-as-release build to CI running essential browsertime tests on autoland

Status: RESOLVED FIXED

(Testing :: Performance, task, P2)

Description

[Greg Mierzwinski [:sparky]]

This bug is for adding, and running a nightly-as-release build in CI for essential browsertime tests on autoland. Ideally, this would be for all platforms at once.

Comment 1

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1820893 - Build nightly-as-release in CI on all desktop platfroms. r?aryx,glandium,bhearsum,#firefox-build-system-reviewers

This patch adds a new nightly-as-release build for Windows, Linux, and MacOSx. These are nightly builds, but built with the following additional flag: ac_add_options --as-milestone=release

Three new builds are also added to CI: macosx64-nightly-as-release-shippable/opt, win64-nightly-as-release-shippable/opt, and linux64-nightly-as-release-shippable/opt

These are used to make 3 test-platforms to run browsertime tests in a following patch.

Comment 2

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1820893 - Run browsertime performance tests on nightly-as-release builds. r?#perftest

This patch adds three new shippable platforms running the nightly-as-release build. At the same time, browsertime essential tests are enabled for all three platforms on autoland.

Depends on D172029

Comment 3

[[e-mail] (:bhearsum)]

For posterity, emilio explained why it's necessary that we do this over in phabricator.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/97d24cd7ec85
Build nightly-as-release in CI on all desktop platfroms. r=aryx,glandium,firefox-build-system-reviewers,bhearsum,taskgraph-reviewers
https://hg.mozilla.org/integration/autoland/rev/13b8251ff5ef
Run browsertime performance tests on nightly-as-release builds. r=perftest-reviewers,taskgraph-reviewers,jmaher,afinder

Comment 5

[Serban Stanca [:SerbanS]]

Backed out for causing py3 failures.

• Backout link
• Push with failures
• Failure Log
• Failure line: taskcluster/test/test_mozilla_central.py::test_test_setting TEST-UNEXPECTED-FAIL

Comment 6

[Greg Mierzwinski [:sparky]]

Attachment: Bug 1820893 - Fix taskcluster test_test_setting unit test failure. r?#taskgraph-reviewers

This patch fixes a unit test failure in the taskcluster (ci) subsuite. The issue was that the new nightly-as-release build was unrecognized, and has dashes in it.

Depends on D172030

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d9b33032be7b
Build nightly-as-release in CI on all desktop platfroms. r=aryx,glandium,firefox-build-system-reviewers,bhearsum,taskgraph-reviewers
https://hg.mozilla.org/integration/autoland/rev/10c146921bc5
Run browsertime performance tests on nightly-as-release builds. r=perftest-reviewers,taskgraph-reviewers,jmaher,afinder

Comment 8

[Cristina Horotan [:chorotan]]

Backed out 2 changesets (bug 1820893) for causing build bustage at GMPChild.cpp.

Backout: https://hg.mozilla.org/integration/autoland/rev/ce2b6d4d58eb4e26368a7e3637b9c834e3c804cf

Failure push: https://treeherder.mozilla.org/jobs?repo=autoland&revision=10c146921bc5b201a46fb0ef967c35890c2c911f

Failure log: https://treeherder.mozilla.org/logviewer?job_id=411205780&repo=autoland&lineNumber=15179

Comment 9

[Greg Mierzwinski [:sparky]]

:emilio, do you know what might be broken in the builds?

Comment 10

[Greg Mierzwinski [:sparky]]

It looks like this failure might be caused by bug 1825759.

Comment 11

[Emilio Cobos Álvarez (:emilio)]

Yes, indeed.

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/8e74ae31481c
Build nightly-as-release in CI on all desktop platfroms. r=aryx,glandium,firefox-build-system-reviewers,bhearsum,taskgraph-reviewers
https://hg.mozilla.org/integration/autoland/rev/77ec1f7dd042
Run browsertime performance tests on nightly-as-release builds. r=perftest-reviewers,taskgraph-reviewers,jmaher,afinder

Comment 13

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/8e74ae31481c
https://hg.mozilla.org/mozilla-central/rev/77ec1f7dd042