1614855 - Perma valgrind-test | non-zero exit code from Valgrind: -139 due to the fact we use Ubuntu 18.04 in GCP

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, defect)

Description

[Cosmin Sabou [:CosminS]]

Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=288428655&repo=autoland

Th link: https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=linux%2Cx64%2Copt%2Cvalgrind-linux64-valgrind%2Fopt%2C%28v%29&fromchange=ee582f48caa16183f496f63dfd85eefb288ba4fb&tochange=e188f8d308078010981f61d7a36d6ff089d0900c&selectedJob=288439179

This is happening also on try: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=busted%2Cexception&classifiedState=unclassified&revision=aa4c96e316731813a008ce636e9df2d34483e3f4&selectedJob=288451872

wcosta on slack: "I believe so, but it is not due to the cloud migration, but due to the fact we use Ubuntu 18.04 in GCP"

Comment 1

[Wander Lairson Costa]

Attachment: Bug 1614855: Run valgrind builds in AWS r=#build

GCE instances use Ubuntu 18.04, which is known to cause issues in
valgrind builds (Bug 1545094), while EC2 uses Ubuntu 14.04.

Move valgrind builds back to GCE to avoid perma fail of these jobs.

Comment 2

[Wander Lairson Costa]

This patch moves valgrind builds back to EC2 as an emergency solution.

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0ce5838679ee
Run valgrind builds in AWS r=froydnj

Comment 4

[Dorel Luca [:dluca]]

https://hg.mozilla.org/releases/mozilla-beta/rev/fb6d34c38085

Comment 5

[Dorel Luca [:dluca]]

https://hg.mozilla.org/releases/mozilla-esr68/rev/bf3997e896c0

Comment 6

[Dorel Luca [:dluca]]

https://hg.mozilla.org/releases/mozilla-release/rev/1627ede858ca

Comment 7

[Razvan Maries]

https://hg.mozilla.org/mozilla-central/rev/0ce5838679ee

Comment 8

[Intermittent Failures Robot]

79 failures in 902 pushes (0.088 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 71
• mozilla-central: 2
• try: 6

Platform breakdown:

• linux64: 60
• android-4-0-armv7-api16: 5
• android-4-0-geckoview-fat-aar: 2
• macosx1014-64-shippable: 3
• linux64-shippable: 5
• android-5-0-x86_64: 2
• osx-cross: 1
• android-5-0-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1614855&startday=2020-02-12&endday=2020-02-12&tree=all

Comment 9

[Intermittent Failures Robot]

85 failures in 4690 pushes (0.018 failures/push) were associated with this bug in the last 7 days.

This is the #4 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 77
• mozilla-central: 2
• try: 6

Platform breakdown:

• linux64: 66
• android-4-0-armv7-api16: 5
• android-4-0-geckoview-fat-aar: 2
• macosx1014-64-shippable: 3
• linux64-shippable: 5
• android-5-0-x86_64: 2
• osx-cross: 1
• android-5-0-aarch64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1614855&startday=2020-02-10&endday=2020-02-16&tree=all