1303543 - Intermittent-infra OSError: [Errno 13] Permission denied: '/home/worker/workspace/logs/log_raw.log'

Status: RESOLVED DUPLICATE of bug 1311442

(Taskcluster :: General, defect)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=3656842&repo=autoland

https://queue.taskcluster.net/v1/task/B9BuljyHSvmiKcgANKqRxw/runs/0/artifacts/public%2Flogs%2Flive_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/B9BuljyHSvmiKcgANKqRxw/runs/0/artifacts/public%2Flogs%2Flive_backing.log&only_show_unexpected=1

Comment 1

[Intermittent Failures Robot]

14 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 14

Platform breakdown:
* android-4-3-armv7-api15: 12
* linux64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-09-12&endday=2016-09-18&tree=all

Comment 2

[Intermittent Failures Robot]

33 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 30
* mozilla-inbound: 3

Platform breakdown:
* linux64: 16
* android-4-3-armv7-api15: 16
* android-4-2-x86: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-09-22&endday=2016-09-22&tree=all

Comment 3

[Intermittent Failures Robot]

43 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 37
* mozilla-inbound: 3
* mozilla-central: 2
* mozilla-aurora: 1

Platform breakdown:
* linux64: 21
* android-4-3-armv7-api15: 21
* android-4-2-x86: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-09-19&endday=2016-09-25&tree=all

Comment 4

[Intermittent Failures Robot]

17 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 17

Platform breakdown:
* android-4-3-armv7-api15: 12
* linux64: 4
* android-api-15-gradle: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-09-27&endday=2016-09-27&tree=all

Comment 5

[Intermittent Failures Robot]

29 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 29

Platform breakdown:
* android-4-3-armv7-api15: 25
* linux64: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-09-28&endday=2016-09-28&tree=all

Comment 6

[Intermittent Failures Robot]

61 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 57
* mozilla-central: 2
* mozilla-inbound: 1
* fx-team: 1

Platform breakdown:
* android-4-3-armv7-api15: 35
* linux64: 23
* android-4-2-x86: 2
* android-api-15-gradle: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-09-29&endday=2016-09-29&tree=all

Comment 7

[Intermittent Failures Robot]

17 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 17

Platform breakdown:
* linux64: 8
* android-4-3-armv7-api15: 8
* android-api-15-gradle: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-10-01&endday=2016-10-01&tree=all

Comment 8

[Intermittent Failures Robot]

219 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 214
* mozilla-inbound: 2
* mozilla-central: 2
* fx-team: 1

Platform breakdown:
* android-4-3-armv7-api15: 123
* linux64: 84
* android-api-15-gradle: 8
* android-4-2-x86: 3
* windows7-32-vm: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-09-26&endday=2016-10-02&tree=all

Comment 9

[Intermittent Failures Robot]

53 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 52
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api15: 32
* linux64: 20
* android-api-15-gradle: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-10-07&endday=2016-10-07&tree=all

Comment 10

[Intermittent Failures Robot]

61 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 60
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api15: 34
* linux64: 26
* android-api-15-gradle: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-10-03&endday=2016-10-09&tree=all

Comment 11

[Intermittent Failures Robot]

37 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 27
* mozilla-central: 10

Platform breakdown:
* android-4-3-armv7-api15: 21
* linux64: 16

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-10-14&endday=2016-10-14&tree=all

Comment 12

[Intermittent Failures Robot]

41 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 27
* mozilla-central: 10
* mozilla-inbound: 4

Platform breakdown:
* android-4-3-armv7-api15: 24
* linux64: 17

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-10-10&endday=2016-10-16&tree=all

Comment 13

[Intermittent Failures Robot]

52 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 50
* fx-team: 2

Platform breakdown:
* android-4-3-armv7-api15: 33
* linux64: 17
* android-api-15-gradle: 1
* android-4-2-x86: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-10-17&endday=2016-10-17&tree=all

Comment 14

[Intermittent Failures Robot]

134 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 133
* mozilla-inbound: 1

Platform breakdown:
* android-4-3-armv7-api15: 75
* linux64: 54
* android-api-15-gradle: 4
* android-4-2-x86: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-10-18&endday=2016-10-18&tree=all

Comment 15

[Joel Maher ( :jmaher ) (UTC -8)]

this is a mix of linux64 and android, we do not see these issues on buildbot jobs.

Comment 16

[Joel Maher ( :jmaher ) (UTC -8)]

here is a log file of a failure:
https://public-artifacts.taskcluster.net/damicuxBRnyLEYwdGE81WQ/0/public/logs/live_backing.log

this is a fresh image.tar download/unpack and we fail upon starting mozharness.  then the next few jobs that are on desktop tests fail.  We need to throw away the image when we get this failure.  I see this often with web-platform-tests which we run from source vs tests.zip, not sure if there is something odd going on there.

Comment 17

[Greg Arndt [:garndt]]

The image is not where these files are.  All of these failures seem to take place in /home/worker/workspace which is a directory residing on the host that is mounted into the container.

Comment 18

[Geoff Brown [:gbrown]]

As in bug 1304930, most of the failures are on autoland. I have been unable to reproduce on try.

Comment 20

[Intermittent Failures Robot]

216 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 213
* fx-team: 2
* mozilla-inbound: 1

Platform breakdown:
* android-4-3-armv7-api15: 127
* linux64: 82
* android-api-15-gradle: 5
* android-4-2-x86: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1303543&startday=2016-10-17&endday=2016-10-23&tree=all