1445631 - Intermittent make[4]: *** Deleting file 'filename'

Status: RESOLVED FIXED

(Firefox Build System :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dluca [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=167896194&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/XpqDBVusRHuMVs9T3EOxBQ/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

17 failures in 141 pushes (0.121 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 12
* autoland: 5

Platform breakdown:
* linux64: 11
* android-4-0-armv7-api16: 3
* linux64-stylo-only: 1
* linux64-noopt: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1445631&startday=2018-03-14&endday=2018-03-14&tree=all

Comment 6

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

The files deleted are object files. First failure is at 2018-03-13 18:28 UTC. All results (ignore the earlier ones with relative paths): https://sql.telemetry.mozilla.org/queries/52055#table

Ted, any idea what's messing up those Linux build jobs and if this is a FBS or a Taskcluster issue? Thank you.

Comment 7

[(not currently active) Ted Mielczarek]

bug 1445413 comment 2 has details and a potential fix in the crate that sccache uses. bug 1445761 comment 1 has other related info.

I'll update sccache to pick up the fix and land a patch to use that updated version in m-c.

Comment 9

[(not currently active) Ted Mielczarek]

Pushed a change to update the jobserver crate in sccache:
https://github.com/mozilla/sccache/commit/13fa450eee47cc53fff4129aaf3c6c30fd2b621e

Comment 10

[(not currently active) Ted Mielczarek]

Attachment: bug 1445631 - update sccache to pick up a fix in the jobserver crate.

Review commit: https://reviewboard.mozilla.org/r/228444/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/228444/

Comment 11

[Chris Manchester (limited bugmail, email directly)]

Comment on attachment 8959635 [details]
bug 1445631 - update sccache to pick up a fix in the jobserver crate.

https://reviewboard.mozilla.org/r/228444/#review234294

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f9e45b228c63
update sccache to pick up a fix in the jobserver crate. r=chmanchester

Comment 13

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/f9e45b228c63

Comment 14

[Intermittent Failures Robot]

41 failures in 814 pushes (0.05 failures/push) were associated with this bug in the last 7 days. 

This is the #32 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-inbound: 25
* autoland: 16

Platform breakdown:
* linux64: 26
* osx-cross: 4
* linux32: 4
* android-4-0-armv7-api16: 3
* osx-cross-noopt: 1
* linux64-stylo-only: 1
* linux64-noopt: 1
* android-5-0-aarch64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1445631&startday=2018-03-12&endday=2018-03-18&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 792 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1445631&startday=2018-04-09&endday=2018-04-15&tree=trunk