1695384 - Intermittent Android 8.0 AArch tests/jit-test/jit-test/tests/<random> | timeout: exec /data/local/tmp/test_root/bin/js: Permission denied (code 127, args "") [0.0 s]

Status: ASSIGNED

(Core :: JavaScript Engine, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: abutkovits [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=331424430&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/F5q5Qg_cRqaeEFpiSguOVA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-02-27T01:11:31.518Z] 01:11:29     INFO - Found Android bogomips: 38
[task 2021-02-27T01:11:31.518Z] 01:11:29     INFO - adb -s FA84C1A00121 logcat -v threadtime Trace:S StrictMode:S ExchangeService:S
[task 2021-02-27T01:11:31.518Z] 01:11:31     INFO - verify_device complete
[task 2021-02-27T01:11:31.518Z] 01:11:31     INFO - Running post-action listener: _resource_record_post_action
[task 2021-02-27T01:11:31.518Z] 01:11:31     INFO - [mozharness: 2021-02-27 01:11:31.421928Z] Finished verify-device step (success)
[task 2021-02-27T01:11:31.518Z] 01:11:31     INFO - [mozharness: 2021-02-27 01:11:31.421989Z] Running install step.
[task 2021-02-27T01:11:31.518Z] 01:11:31     INFO - Running pre-action listener: _resource_record_pre_action
[task 2021-02-27T01:12:39.054Z] 01:11:31     INFO - Running main action method: install
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Finished installing apps for pixel2-16
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Running post-action listener: _resource_record_post_action
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - [mozharness: 2021-02-27 01:11:52.912059Z] Finished install step (success)
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - [mozharness: 2021-02-27 01:11:52.912113Z] Running run-tests step.
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Running pre-action listener: _resource_record_pre_action
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Running pre-action listener: _set_gcov_prefix
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Running pre-action listener: timed_screenshots
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Running main action method: run_tests
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Running on pixel2-16 the command /builds/task_161438793697515/workspace/build/venv/bin/python -u /builds/task_161438793697515/workspace/build/tests/jit-test/jit-test/jit_test.py ../../bin/js --remote -j 1 --localLib=../../bin --no-slow --no-progress --format=automation --jitflags=debug --deviceSerial=FA84C1A00121 --this-chunk 9 --total-chunks 10
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - ##### jittest log begins
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Running command: ['/builds/task_161438793697515/workspace/build/venv/bin/python', '-u', '/builds/task_161438793697515/workspace/build/tests/jit-test/jit-test/jit_test.py', '../../bin/js', '--remote', '-j', '1', '--localLib=../../bin', '--no-slow', '--no-progress', '--format=automation', '--jitflags=debug', '--deviceSerial=FA84C1A00121', '--this-chunk', '9', '--total-chunks', '10'] in /builds/task_161438793697515/workspace/build/tests/jit-test/jit-test
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Copy/paste: /builds/task_161438793697515/workspace/build/venv/bin/python -u /builds/task_161438793697515/workspace/build/tests/jit-test/jit-test/jit_test.py ../../bin/js --remote -j 1 --localLib=../../bin --no-slow --no-progress --format=automation --jitflags=debug --deviceSerial=FA84C1A00121 --this-chunk 9 --total-chunks 10
[task 2021-02-27T01:12:39.054Z] 01:11:52     INFO - Using env: (same as previous command)
[task 2021-02-27T01:12:39.054Z] 01:11:53     INFO -  Using adb 1.0.41
[task 2021-02-27T01:12:39.054Z] 01:11:53     INFO -  /system/bin/ls -1A supported
[task 2021-02-27T01:12:39.054Z] 01:11:56     INFO -  Native cp support: True
[task 2021-02-27T01:12:39.054Z] 01:11:56     INFO -  Native chmod -R support: True
[task 2021-02-27T01:12:39.054Z] 01:11:56     INFO -  Native chown -R support: True
[task 2021-02-27T01:12:39.054Z] 01:11:57     INFO -  Native normal pidof support: True
[task 2021-02-27T01:12:39.054Z] 01:11:57     INFO -  adbd not restarted as root
[task 2021-02-27T01:12:39.054Z] 01:11:57     INFO -  su -c setenforce 0 exitcode 0, stdout: None
[task 2021-02-27T01:12:39.054Z] 01:11:57     INFO -  su -c supported
[task 2021-02-27T01:12:39.054Z] 01:11:58     INFO -  Setting SELinux Permissive
[task 2021-02-27T01:12:39.054Z] 01:12:03     INFO -  Setting test_root to /data/local/tmp/test_root
[task 2021-02-27T01:12:39.054Z] 01:12:37     INFO -  tasks_adb_remote.py : Device initialization completed
[task 2021-02-27T01:12:39.054Z] 01:12:37     INFO -  tasks_adb_remote.py : Create batch script
[task 2021-02-27T01:12:39.054Z] 01:12:38     INFO -  tasks_adb_remote.py : Batch script created
[task 2021-02-27T01:12:39.054Z] 01:12:38     INFO -  timeout: exec /data/local/tmp/test_root/bin/js: Permission denied
[task 2021-02-27T01:12:39.054Z] 01:12:38     INFO -  timeout: exec /data/local/tmp/test_root/bin/js: Permission denied
[task 2021-02-27T01:12:39.054Z] 01:12:38     INFO -  Exit code: 127
[task 2021-02-27T01:12:39.054Z] 01:12:38     INFO -  FAIL - jaeger/loops/property-1.js
[task 2021-02-27T01:12:39.054Z] 01:12:38  WARNING -  TEST-UNEXPECTED-FAIL | tests/jit-test/jit-test/tests/jaeger/loops/property-1.js | timeout: exec /data/local/tmp/test_root/bin/js: Permission denied (code 127, args "") [0.0 s]```

Comment 1

[Intermittent Failures Robot]

1 failures in 4327 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-02-22&endday=2021-02-28&tree=all

Comment 4

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Could these failures be a regression from bug 1690570?

Comment 5

[Nicolas B. Pierron [:nbp]]

This is the first time I see this issue, in all the testing I've done so far on these patches this sounds very unlikely, and the error message is clear enough to not be confused with other issues.

It sounds like the chmod / upload did not work as expected, and that we might have ignored the error status.
I will look at this intermittent if it re-appear in the future.

Comment 6

[Nicolas B. Pierron [:nbp]]

(In reply to Nicolas B. Pierron [:nbp] from comment #5)

I will look at this intermittent if it re-appear in the future.

I just noticed the duplicates of this bug which did not appear in the orange factor, I will look at this bug later this week.

Comment 7

[Nicolas B. Pierron [:nbp]]

Bug 1686068 suggests this bug existed, but instead of having a binary it was a directory.

I will add assertions to check that we are pushing files to the device. This would help us bisect if this is an issue of adb or an issue in the build output.

Comment 8

[Nicolas B. Pierron [:nbp]]

Attachment: Bug 1695384 - Android JS tests: Investigate intermittent non-executable binary.

Comment 9

[Nicolas B. Pierron [:nbp]]

(setting leave-open as the current patch is not meant to fix this issue, but to bisect where this issue happens)

Comment 10

[Ted Campbell [:tcampbell]]

Since we have the helper script on the device, we could have it check that the js file exists and check its permissions (reporting something useful). There are also some verbose logs in the adb stack we could consider enabling in automation but that is a bit annoying.

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a0f0682883e1
Android JS tests: Investigate intermittent non-executable binary. r=tcampbell

Comment 12

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/a0f0682883e1

Comment 13

[Intermittent Failures Robot]

2 failures in 4622 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-shippable: 1
  • opt: 1
• android-hw-p2-8-0-android-aarch64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-03-08&endday=2021-03-14&tree=all

Comment 14

[Intermittent Failures Robot]

1 failures in 3967 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-03-22&endday=2021-03-28&tree=all

Comment 15

[Intermittent Failures Robot]

2 failures in 3125 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64: 1
  • opt: 1
• android-hw-p2-8-0-android-aarch64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-03-29&endday=2021-04-04&tree=all

Comment 17

[Intermittent Failures Robot]

2 failures in 3279 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-arm7-api-16: 1
  • opt: 1
• android-hw-p2-8-0-android-aarch64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-05-03&endday=2021-05-09&tree=all

Comment 18

[Intermittent Failures Robot]

1 failures in 3061 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 19

[Intermittent Failures Robot]

3 failures in 2908 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-05-24&endday=2021-05-30&tree=all

Comment 20

[Intermittent Failures Robot]

1 failures in 2888 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 21

[Intermittent Failures Robot]

1 failures in 3115 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-06-21&endday=2021-06-27&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 2387 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 23

[Intermittent Failures Robot]

1 failures in 2940 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-07-19&endday=2021-07-25&tree=all

Comment 24

[Intermittent Failures Robot]

1 failures in 2899 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-08-16&endday=2021-08-22&tree=all

Comment 25

[Alexandru Michis [:malexandru]]

This is also happening on non-AArch Android 8.0 platforms: https://treeherder.mozilla.org/logviewer?job_id=349717198&repo=mozilla-central&lineNumber=1523

Nicolas, should we modify this bug's summary to include those as well, or create a new one for them?

Comment 26

[Intermittent Failures Robot]

1 failures in 2580 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-arm7-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-08-23&endday=2021-08-29&tree=all

Comment 27

[Intermittent Failures Robot]

1 failures in 3375 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• android-hw-p2-8-0-arm7-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-09-13&endday=2021-09-19&tree=all

Comment 28

[Intermittent Failures Robot]

1 failures in 3186 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2021-10-18&endday=2021-10-24&tree=all

Comment 29

[Intermittent Failures Robot]

1 failures in 3444 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-arm7-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2022-01-17&endday=2022-01-23&tree=all

Comment 30

[Intermittent Failures Robot]

1 failures in 3304 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2022-03-14&endday=2022-03-20&tree=all

Comment 31

[Intermittent Failures Robot]

1 failures in 3323 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2022-03-28&endday=2022-04-03&tree=all

Comment 32

[Intermittent Failures Robot]

1 failures in 3159 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-hw-p2-8-0-android-aarch64-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2022-04-18&endday=2022-04-24&tree=all

Comment 33

[Intermittent Failures Robot]

1 failures in 3170 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-arm7-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2022-06-13&endday=2022-06-19&tree=all

Comment 34

[Intermittent Failures Robot]

1 failures in 3497 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-p2-8-0-arm7-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2022-07-18&endday=2022-07-24&tree=all

Comment 35

[Intermittent Failures Robot]

1 failures in 3558 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• toolchains: 1

Platform and build breakdown:

• android-hw-p2-8-0-arm7-qr: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1695384&startday=2022-12-12&endday=2022-12-18&tree=all