1707041 - Perma mozilla-release Android toolkit/components/utils/test/unit/test_ClientEnvironment.js | xpcshell return code: 0

Status: RESOLVED DUPLICATE of bug 1760098

(Firefox :: Normandy Client, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=337448915&repo=try
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/QqLJaRrBRySWLWJo7t2lPA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2021-04-22T13:47:56.228Z] 13:47:56     INFO -  TEST-START | toolkit/components/utils/test/unit/test_ClientEnvironment.js
[task 2021-04-22T13:47:56.261Z] 13:47:56     INFO -  adb launch_application: am startservice -W -n 'org.mozilla.geckoview.test/org.mozilla.geckoview.test.XpcshellTestRunnerService$i0' -a android.intent.action.MAIN --es arg8 'const _MOZINFO_JS_PATH = "/data/local/tmp/test_root/xpc/p/36b793d6-36d0-4392-b5d3-ce62e8eb190e/mozinfo.json";' --es arg9 -e --es arg0 -g --es arg1 /data/local/tmp/test_root/xpcb --es arg2 --greomni --es arg3 /data/local/tmp/test_root/xpcb/geckoview-androidTest.apk --es arg4 -m --es arg5 -e --es arg6 'const _HEAD_JS_PATH = "/data/local/tmp/test_root/xpc/head.js";' --es arg7 -e --es arg26 '_execute_test(); quit(0);' --es arg25 -e --es arg24 'const _TEST_NAME = "toolkit/components/utils/test/unit/test_ClientEnvironment.js";' --es arg23 -e --es arg22 'const _TEST_FILE = ["test_ClientEnvironment.js"];' --es arg21 -e --es arg20 'const _TEST_CWD = "/data/local/tmp/test_root/xpc/toolkit/components/utils/test/unit";' --ez use_multiprocess True --es env20 TMPDIR=/data/local/tmp/test_root/xpc/p/36b793d6-36d0-4392-b5d3-ce62e8eb190e --es arg12 'const _TESTING_MODULES_DIR = "/data/local/tmp/test_root/xpc/m";' --es arg13 -f --es arg10 'const _PREFS_FILE = "/data/local/tmp/test_root/xpc/user.js";' --es arg11 -e --es arg16 'const _HEAD_FILES = [];' --es arg17 -e --es arg14 /data/local/tmp/test_root/xpc/head.js --es arg15 -e --es arg18 'const _JSDEBUGGER_PORT = 0;' --es arg19 -e --es env9 MOZHTTP2_PORT=44051 --es env8 GRE_HOME=/data/local/tmp/test_root/xpcb --es out_file /data/local/tmp/test_root/xpc/logs/xpcshell-123b3c8e-c566-403f-94b5-ef28d22d5056.log --es env3 XPCSHELL_MINIDUMP_DIR=/data/local/tmp/test_root/xpc/minidumps/36b793d6-36d0-4392-b5d3-ce62e8eb190e --es env2 XPCOM_DEBUG_BREAK=stack-and-abort --es env1 MOZ_DISABLE_SOCKET_PROCESS_SANDBOX=1 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_ANDROID_DATA_DIR=/data/local/tmp/test_root/xpcb --es env6 XPCSHELL_TEST_TEMP_DIR=/data/local/tmp/test_root/xpc/tmp/36477620-c7a3-4017-aacb-1af7fc6b99f8 --es env5 MOZ_DISABLE_CONTENT_SANDBOX=1 --es env4 MOZ_WEBRENDER=0 --es env19 MOZ_ANDROID_CPU_ABI=x86_64 --es env18 HOME=/data/local/tmp/test_root/xpc/p --es env17 MOZ_LINKER_CACHE=/data/local/tmp/test_root/xpcb --es env16 MOZ_DEVELOPER_REPO_DIR=/builds/worker/checkouts/gecko --es env15 MOZ_CRASHREPORTER_NO_REPORT=1 --es env14 MOZNODE_EXEC_PORT=40449 --es env13 XPCSHELL_TEST_PROFILE_DIR=/data/local/tmp/test_root/xpc/p/36b793d6-36d0-4392-b5d3-ce62e8eb190e --es env12 LD_LIBRARY_PATH=/data/local/tmp/test_root/xpcb --es env11 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env10 MOZ_DISABLE_SOCKET_PROCESS=1
[task 2021-04-22T13:47:56.599Z] 13:47:56     INFO -  remotexpcshelltests.py | Launched Test App PID=13532
[task 2021-04-22T13:47:57.039Z] 13:47:57     INFO -  remotexpcshelltests.py | Application ran for: 0:00:00.810169
[task 2021-04-22T13:47:57.154Z] 13:47:57  WARNING -  TEST-UNEXPECTED-FAIL | toolkit/components/utils/test/unit/test_ClientEnvironment.js | xpcshell return code: 0
[task 2021-04-22T13:47:57.154Z] 13:47:57     INFO -  TEST-INFO took 926ms
[task 2021-04-22T13:47:57.154Z] 13:47:57     INFO -  >>>>>>>
[task 2021-04-22T13:47:57.154Z] 13:47:57     INFO -  (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2021-04-22T13:47:57.154Z] 13:47:57     INFO -  (xpcshell/head.js) | test run_next_test 0 pending (2)
[task 2021-04-22T13:47:57.154Z] 13:47:57     INFO -  (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2021-04-22T13:47:57.154Z] 13:47:57     INFO -  running event loop
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  toolkit/components/utils/test/unit/test_ClientEnvironment.js | Starting
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  (xpcshell/head.js) | test pending (2)
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  TEST-PASS | toolkit/components/utils/test/unit/test_ClientEnvironment.js |  - OS data should be available in the context - true == true
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  TEST-PASS | toolkit/components/utils/test/unit/test_ClientEnvironment.js |  - At most one OS should match - true == true
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  (xpcshell/head.js) | test run_next_test 0 finished (2)
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  (xpcshell/head.js) | test run_next_test 1 pending (2)
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  (xpcshell/head.js) | test finished (2)
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  toolkit/components/utils/test/unit/test_ClientEnvironment.js | Starting
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  (xpcshell/head.js) | test pending (2)
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  TEST-PASS | toolkit/components/utils/test/unit/test_ClientEnvironment.js |  - Test environment does not have attribution data - "NS_ERROR_FILE_NOT_FOUND" == "NS_ERROR_FILE_NOT_FOUND"
[task 2021-04-22T13:47:57.155Z] 13:47:57     INFO -  (xpcshell/head.js) | test run_next_test 1 finished (2)
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  (xpcshell/head.js) | test run_next_test 2 pending (2)
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  (xpcshell/head.js) | test finished (2)
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  toolkit/components/utils/test/unit/test_ClientEnvironment.js | Starting testLiveTelemetry
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  (xpcshell/head.js) | test testLiveTelemetry pending (2)
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  (xpcshell/head.js) | test run_next_test 2 finished (2)
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  Unexpected exception TypeError: ClientEnvironmentBase.liveTelemetry.main is null at test_ClientEnvironment.js:96
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  testLiveTelemetry@test_ClientEnvironment.js:96:1
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  _do_main@/data/local/tmp/test_root/xpc/head.js:241:6
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  _execute_test@/data/local/tmp/test_root/xpc/head.js:598:5
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  @-e:1:1
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  exiting test
[task 2021-04-22T13:47:57.156Z] 13:47:57     INFO -  <<<<<<<```

Comment 1

[Intermittent Failures Robot]

1 failures in 3224 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-04-19&endday=2021-04-25&tree=all

Comment 2

[Intermittent Failures Robot]

1 failures in 3706 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-04-26&endday=2021-05-02&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 3279 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-05-03&endday=2021-05-09&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 3061 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 5

[Intermittent Failures Robot]

4 failures in 2908 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-05-24&endday=2021-05-30&tree=all

Comment 6

[Intermittent Failures Robot]

2 failures in 3065 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-05-31&endday=2021-06-06&tree=all

Comment 7

[Intermittent Failures Robot]

4 failures in 3502 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-06-07&endday=2021-06-13&tree=all

Comment 8

[Intermittent Failures Robot]

3 failures in 2888 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 9

[Intermittent Failures Robot]

3 failures in 3115 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-06-21&endday=2021-06-27&tree=all

Comment 10

[Intermittent Failures Robot]

3 failures in 2387 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 11

[Intermittent Failures Robot]

8 failures in 2224 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 6
• mozilla-esr91: 1
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 7
  • opt: 7
• android-em-7-0-x86_64: 1
  • debug: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-07-12&endday=2021-07-18&tree=all

Comment 12

[Intermittent Failures Robot]

3 failures in 2940 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-release: 1

Platform and build breakdown:

• android-em-7-0-x86_64: 1
  • debug: 1
• android-em-7-0-x86_64-shippable: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-07-19&endday=2021-07-25&tree=all

Comment 13

[Intermittent Failures Robot]

3 failures in 3131 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2
• try: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-07-26&endday=2021-08-01&tree=all

Comment 14

[Intermittent Failures Robot]

4 failures in 2829 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-08-02&endday=2021-08-08&tree=all

Comment 15

[Intermittent Failures Robot]

2 failures in 3025 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-08-09&endday=2021-08-15&tree=all

Comment 16

[Intermittent Failures Robot]

7 failures in 2899 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3
• try: 4

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 3
  • opt: 3
• android-em-7-0-x86_64-shippable-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-08-16&endday=2021-08-22&tree=all

Comment 17

[Intermittent Failures Robot]

4 failures in 2580 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-lite-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-08-23&endday=2021-08-29&tree=all

Comment 18

[Intermittent Failures Robot]

9 failures in 3084 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 9

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-lite-qr: 4
  • opt: 4
• android-em-7-0-x86_64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-08-30&endday=2021-09-05&tree=all

Comment 19

[Andreea Pavel [:apavel]]

Hi Elise, this is currently perma-failing, can you please take a look?
TH link: https://treeherder.mozilla.org/jobs?repo=mozilla-release&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&fromchange=fbfba27ecdf62e286a6ed285bb78250c02d3d4a1&selectedTaskRun=PaHcohZrSiG2-gQrn62nNw.0&searchStr=android-em-7-0-x86_64-shippable-lite-qr%2Copt%2CXpcshell%2Ctests%2Ctest-android-em-7.0-x86_64-shippable-lite-qr%2Fopt-geckoview-xpcshell-e10s%2CX1&tochange=bc7bb264b4442d05f790b4d7cb0a4726a9288b27

Failure log: https://treeherder.mozilla.org/logviewer?job_id=350800084&repo=mozilla-release&lineNumber=8755

[task 2021-09-07T15:38:32.342Z] 15:38:32     INFO -  TEST-START | toolkit/xre/test/test_launch_without_hang.js
[task 2021-09-07T15:38:32.342Z] 15:38:32     INFO -  TEST-SKIP | toolkit/xre/test/test_launch_without_hang.js | took 0ms
[task 2021-09-07T15:38:32.342Z] 15:38:32     INFO -  Retrying tests that failed when run in parallel.
[task 2021-09-07T15:38:32.979Z] 15:38:32     INFO -  TEST-START | toolkit/components/utils/test/unit/test_ClientEnvironment.js
[task 2021-09-07T15:38:33.012Z] 15:38:33     INFO -  adb launch_application: am startservice -W -n 'org.mozilla.geckoview.test/org.mozilla.geckoview.test.XpcshellTestRunnerService$i0' -a android.intent.action.MAIN --es env0 XPCOM_DEBUG_BREAK=stack-and-abort --es env1 MOZ_CRASHREPORTER=1 --es env2 MOZ_CRASHREPORTER_NO_REPORT=1 --es env3 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env4 MOZ_DEVELOPER_REPO_DIR=/builds/worker/checkouts/gecko --es env5 MOZ_DISABLE_CONTENT_SANDBOX=1 --es env6 MOZ_DISABLE_SOCKET_PROCESS=1 --es env7 MOZ_WEBRENDER=1 --es env8 MOZ_ACCELERATED=1 --es env9 LD_LIBRARY_PATH=/data/local/tmp/test_root/xpcb --es env10 MOZ_LINKER_CACHE=/data/local/tmp/test_root/xpcb --es env11 GRE_HOME=/data/local/tmp/test_root/xpcb --es env12 XPCSHELL_TEST_PROFILE_DIR=/data/local/tmp/test_root/xpc/p/3e2b21e3-f55e-4bba-a3ab-b1093112d523 --es env13 HOME=/data/local/tmp/test_root/xpc/p --es env14 XPCSHELL_TEST_TEMP_DIR=/data/local/tmp/test_root/xpc/tmp/f1f948c8-1b2e-4e8b-83a6-e2b79cc48a76 --es env15 MOZ_ANDROID_DATA_DIR=/data/local/tmp/test_root/xpcb --es env16 MOZ_ANDROID_CPU_ABI=x86_64 --es env17 MOZHTTP2_PORT=42959 --es env18 MOZNODE_EXEC_PORT=41907 --es env19 TMPDIR=/data/local/tmp/test_root/xpc/p/3e2b21e3-f55e-4bba-a3ab-b1093112d523 --es env20 XPCSHELL_MINIDUMP_DIR=/data/local/tmp/test_root/xpc/minidumps/3e2b21e3-f55e-4bba-a3ab-b1093112d523 --es arg0 -g --es arg1 /data/local/tmp/test_root/xpcb --es arg2 --greomni --es arg3 /data/local/tmp/test_root/xpcb/geckoview-androidTest.apk --es arg4 -m --es arg5 -e --es arg6 'const _HEAD_JS_PATH = "/data/local/tmp/test_root/xpc/head.js";' --es arg7 -e --es arg8 'const _MOZINFO_JS_PATH = "/data/local/tmp/test_root/xpc/p/3e2b21e3-f55e-4bba-a3ab-b1093112d523/mozinfo.json";' --es arg9 -e --es arg10 'const _PREFS_FILE = "/data/local/tmp/test_root/xpc/user.js";' --es arg11 -e --es arg12 'const _TESTING_MODULES_DIR = "/data/local/tmp/test_root/xpc/m";' --es arg13 -f --es arg14 /data/local/tmp/test_root/xpc/head.js --es arg15 -e --es arg16 'const _HEAD_FILES = [];' --es arg17 -e --es arg18 'const _JSDEBUGGER_PORT = 0;' --es arg19 -e --es arg20 'const _TEST_CWD = "/data/local/tmp/test_root/xpc/toolkit/components/utils/test/unit";' --es arg21 -e --es arg22 'const _TEST_FILE = ["test_ClientEnvironment.js"];' --es arg23 -e --es arg24 'const _TEST_NAME = "toolkit/components/utils/test/unit/test_ClientEnvironment.js";' --es arg25 -e --es arg26 '_execute_test(); quit(0);' --ez use_multiprocess True --es out_file /data/local/tmp/test_root/xpc/logs/xpcshell-a56cbd80-60f2-46d0-9cbe-e93e59e1d237.log
[task 2021-09-07T15:38:33.288Z] 15:38:33     INFO -  remotexpcshelltests.py | Launched Test App PID=4064
[task 2021-09-07T15:38:33.708Z] 15:38:33     INFO -  remotexpcshelltests.py | Application ran for: 0:00:00.728724
[task 2021-09-07T15:38:33.813Z] 15:38:33  WARNING -  TEST-UNEXPECTED-FAIL | toolkit/components/utils/test/unit/test_ClientEnvironment.js | xpcshell return code: 0
[task 2021-09-07T15:38:33.813Z] 15:38:33     INFO -  TEST-INFO took 833ms
[task 2021-09-07T15:38:33.813Z] 15:38:33     INFO -  >>>>>>>
[task 2021-09-07T15:38:33.813Z] 15:38:33     INFO -  (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2021-09-07T15:38:33.814Z] 15:38:33     INFO -  (xpcshell/head.js) | test run_next_test 0 pending (2)
[task 2021-09-07T15:38:33.814Z] 15:38:33     INFO -  (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2021-09-07T15:38:33.814Z] 15:38:33     INFO -  running event loop
[task 2021-09-07T15:38:33.814Z] 15:38:33     INFO -  toolkit/components/utils/test/unit/test_ClientEnvironment.js | Starting
[task 2021-09-07T15:38:33.814Z] 15:38:33     INFO -  (xpcshell/head.js) | test pending (2)
[task 2021-09-07T15:38:33.815Z] 15:38:33     INFO -  TEST-PASS | toolkit/components/utils/test/unit/test_ClientEnvironment.js |  - OS data should be available in the context - true == true
[task 2021-09-07T15:38:33.815Z] 15:38:33     INFO -  TEST-PASS | toolkit/components/utils/test/unit/test_ClientEnvironment.js |  - At most one OS should match - true == true
[task 2021-09-07T15:38:33.815Z] 15:38:33     INFO -  (xpcshell/head.js) | test run_next_test 0 finished (2)
[task 2021-09-07T15:38:33.816Z] 15:38:33     INFO -  (xpcshell/head.js) | test run_next_test 1 pending (2)
[task 2021-09-07T15:38:33.816Z] 15:38:33     INFO -  (xpcshell/head.js) | test finished (2)
[task 2021-09-07T15:38:33.816Z] 15:38:33     INFO -  toolkit/components/utils/test/unit/test_ClientEnvironment.js | Starting
[task 2021-09-07T15:38:33.816Z] 15:38:33     INFO -  (xpcshell/head.js) | test pending (2)
[task 2021-09-07T15:38:33.816Z] 15:38:33     INFO -  TEST-PASS | toolkit/components/utils/test/unit/test_ClientEnvironment.js |  - Test environment does not have attribution data - "NS_ERROR_FILE_NOT_FOUND" == "NS_ERROR_FILE_NOT_FOUND"
[task 2021-09-07T15:38:33.816Z] 15:38:33     INFO -  (xpcshell/head.js) | test run_next_test 1 finished (2)
[task 2021-09-07T15:38:33.817Z] 15:38:33     INFO -  (xpcshell/head.js) | test run_next_test 2 pending (2)
[task 2021-09-07T15:38:33.817Z] 15:38:33     INFO -  (xpcshell/head.js) | test finished (2)
[task 2021-09-07T15:38:33.817Z] 15:38:33     INFO -  toolkit/components/utils/test/unit/test_ClientEnvironment.js | Starting testLiveTelemetry
[task 2021-09-07T15:38:33.817Z] 15:38:33     INFO -  (xpcshell/head.js) | test testLiveTelemetry pending (2)
[task 2021-09-07T15:38:33.817Z] 15:38:33     INFO -  (xpcshell/head.js) | test run_next_test 2 finished (2)
[task 2021-09-07T15:38:33.817Z] 15:38:33     INFO -  Unexpected exception TypeError: ClientEnvironmentBase.liveTelemetry.main is null at test_ClientEnvironment.js:96
[task 2021-09-07T15:38:33.818Z] 15:38:33     INFO -  testLiveTelemetry@test_ClientEnvironment.js:96:1
[task 2021-09-07T15:38:33.818Z] 15:38:33     INFO -  _do_main@/data/local/tmp/test_root/xpc/head.js:240:6
[task 2021-09-07T15:38:33.818Z] 15:38:33     INFO -  _execute_test@/data/local/tmp/test_root/xpc/head.js:597:5
[task 2021-09-07T15:38:33.818Z] 15:38:33     INFO -  @-e:1:1
[task 2021-09-07T15:38:33.818Z] 15:38:33     INFO -  exiting test
[task 2021-09-07T15:38:33.818Z] 15:38:33     INFO -  <<<<<<<
[task 2021-09-07T15:38:33.931Z] 15:38:33     INFO -  Cleaning up profile for /builds/worker/workspace/build/tests/xpcshell/tests/toolkit/components/utils/test/unit/test_ClientEnvironment.js folder: /data/local/tmp/test_root/xpc/p/3e2b21e3-f55e-4bba-a3ab-b1093112d523
[task 2021-09-07T15:38:34.247Z] 15:38:34     INFO -  INFO | Result summary:
[task 2021-09-07T15:38:34.247Z] 15:38:34     INFO -  INFO | Passed: 669
[task 2021-09-07T15:38:34.248Z] 15:38:34  WARNING -  INFO | Failed: 1
[task 2021-09-07T15:38:34.248Z] 15:38:34  WARNING -  One or more unittests failed.
[task 2021-09-07T15:38:34.248Z] 15:38:34     INFO -  INFO | Todo: 8
[task 2021-09-07T15:38:34.248Z] 15:38:34     INFO -  INFO | Retried: 1
[task 2021-09-07T15:38:34.249Z] 15:38:34     INFO -  SUITE-END | took 462s
[task 2021-09-07T15:38:34.250Z] 15:38:34     INFO -  Node moz-http2 server shutting down ...
[task 2021-09-07T15:38:34.305Z] 15:38:34    ERROR - Return code: 1
[task 2021-09-07T15:38:34.305Z] 15:38:34     INFO - TinderboxPrint: xpcshell<br/>669/<em class="testfail">1</em>/8
[task 2021-09-07T15:38:34.305Z] 15:38:34     INFO - ##### xpcshell log ends
[task 2021-09-07T15:38:34.306Z] 15:38:34  WARNING - # TBPL WARNING #
[task 2021-09-07T15:38:34.306Z] 15:38:34  WARNING - setting return code to 1

Comment 20

[Kevin Brosnan [Ex-Mozilla]]

This looks to be Glean/Telemetry code. See if Michael Droettboom knows who should own this or redirect.

Comment 21

[Michael Droettboom [:mdroettboom]]

This looks like an issue with the legacy telemetry system which is written / maintained by the Fenix / Android team, not the Glean SDK team.

Comment 22

[[ex-Mozilla] Agi Sferro | :agi]

(In reply to Michael Droettboom [:mdroettboom] from comment #21)

This looks like an issue with the legacy telemetry system which is written / maintained by the Fenix / Android team, not the Glean SDK team.

I don't believe this is accurate, we (GeckoView / Android) don't maintain the telemetry system, and likewise not the Fenix team (who don't even use mozilla-central). Michael can you figure this out with Emily Toop (GV manager)?

Comment 23

[Michael Droettboom [:mdroettboom]]

Sorry -- too many telemetry systems ;) chutten: I think maybe you have better context than I do to figure out how to triage this.

Comment 24

[Chris H-C :chutten]

test_ClientEnvironment.jsm tests ClientEnvironment.sjm which is part of Normandy (see bug 1472781) (( it reflects part of the Telemetry Environment in a way that Normandy can use. ))

It might be perma-failing due to bug 1722082 which :aryx already See Also'd. :Gijs, does this sound like something that may be related?

Also, :mythmon, does Normandy Client need test coverage on Android? Maybe we skip-if this test?

Comment 25

[:Gijs (he/him)]

As my bmo name indicates, I'm out until Monday the 20th, and so can't look much right now but:

(In reply to Chris H-C :chutten from comment #24)

test_ClientEnvironment.jsm tests ClientEnvironment.sjm which is part of Normandy (see bug 1472781) (( it reflects part of the Telemetry Environment in a way that Normandy can use. ))

It might be perma-failing due to bug 1722082 which :aryx already See Also'd. :Gijs, does this sound like something that may be related?

Not directly in the sense of the crashes that would occur from bug 1721627; the test isn't crashing, just failing:

[task 2021-09-07T15:38:33.817Z] 15:38:33 INFO - Unexpected exception TypeError: ClientEnvironmentBase.liveTelemetry.main is null at test_ClientEnvironment.js:96

I don't know enough about telemetry to know why that property would be null.

Is the same test passing on trunk/beta, or is it disabled, or...?

Comment 26

[Michael Cooper [:mythmon]]

Also, :mythmon, does Normandy Client need test coverage on Android? Maybe we skip-if this test?

Normandy doesn't need coverage on Android, however ClientEnvironment is used by more than Normandy these days. It's also used by at least Remote Settings and Nimbus. I'm not sure if they use it on Android though.

Mat, Andrei, can you comment on if we need ClientEnvironment.jsm on Android for Remote Settings (Mat) or Nimbus (Andrei)?

Comment 27

[Mathieu Leplatre [:leplatrem]]

In theory yes we need it. We want to offer the target filters feature everywhere RS is supported.
However, so far no collection has leveraged it, so if we have to deprecate it, we could.

Comment 28

[Intermittent Failures Robot]

9 failures in 3266 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 9

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-lite-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-09-06&endday=2021-09-12&tree=all

Comment 29

[Andrei Oprea [:andreio]]

Nimbus desktop code doesn't support Android so I don't have anything against skipping.

Comment 30

[Intermittent Failures Robot]

8 failures in 3375 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 6
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 4
  • opt: 4
• android-em-7-0-x86_64-shippable-lite-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-09-13&endday=2021-09-19&tree=all

Comment 31

[:Gijs (he/him)]

(In reply to Mathieu Leplatre [:leplatrem] from comment #27)

In theory yes we need it. We want to offer the target filters feature everywhere RS is supported.
However, so far no collection has leveraged it, so if we have to deprecate it, we could.

Sounds like we should "just" make ClientEnvironment.jsm not break on Android instead?

Comment 32

[Intermittent Failures Robot]

10 failures in 2873 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 8
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 5
  • opt: 5
• android-em-7-0-x86_64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-09-20&endday=2021-09-26&tree=all

Comment 33

[Intermittent Failures Robot]

4 failures in 3376 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-09-27&endday=2021-10-03&tree=all

Comment 34

[Intermittent Failures Robot]

6 failures in 3626 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 3
  • opt: 3
• android-em-7-0-x86_64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-10-04&endday=2021-10-10&tree=all

Comment 35

[Intermittent Failures Robot]

8 failures in 3315 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 6
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 5
  • opt: 5
• android-em-7-0-x86_64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-10-11&endday=2021-10-17&tree=all

Comment 36

[Intermittent Failures Robot]

6 failures in 3186 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 3
  • opt: 3
• android-em-7-0-x86_64-shippable-lite-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-10-18&endday=2021-10-24&tree=all

Comment 37

[Intermittent Failures Robot]

10 failures in 2845 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 10

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 5
  • opt: 5
• android-em-7-0-x86_64-shippable-lite-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-10-25&endday=2021-10-31&tree=all

Comment 38

[Ryan VanderMeulen [:RyanVM]]

(In reply to :Gijs (he/him) from comment #31)

Sounds like we should "just" make ClientEnvironment.jsm not break on Android instead?

It's not great to leave tests permafailing on release for multiple cycles. Can you please respond to help move this bug forward?

Comment 39

[Intermittent Failures Robot]

6 failures in 3030 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 6

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 3
  • opt: 3
• android-em-7-0-x86_64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-11-01&endday=2021-11-07&tree=all

Comment 40

[Mathieu Leplatre [:leplatrem]]

I can see here that a similar code path is tested, and the test does not seem to be disabled on Android.

Same for test_amo_stats_telemetry.js.

I don't really know what to do with that :(
At this point, I could offer to disable the test and cannot invest much time into this.

Comment 41

[Intermittent Failures Robot]

1 failures in 2723 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-11-08&endday=2021-11-14&tree=all

Comment 42

[Intermittent Failures Robot]

12 failures in 3259 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 10
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 6
  • opt: 6
• android-em-7-0-x86_64-shippable-qr: 6
  • opt: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-11-15&endday=2021-11-21&tree=all

Comment 43

[Intermittent Failures Robot]

5 failures in 2819 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 3
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-11-22&endday=2021-11-28&tree=all

Comment 44

[Intermittent Failures Robot]

4 failures in 3170 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 4

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 2
  • opt: 2
• android-em-7-0-x86_64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-11-29&endday=2021-12-05&tree=all

Comment 45

[Intermittent Failures Robot]

7 failures in 3319 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 5
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 4
  • opt: 4
• android-em-7-0-x86_64-shippable-lite-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-12-06&endday=2021-12-12&tree=all

Comment 46

[Intermittent Failures Robot]

10 failures in 3263 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 8
• try: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-qr: 5
  • opt: 5
• android-em-7-0-x86_64-shippable-lite-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-12-13&endday=2021-12-19&tree=all

Comment 47

[Intermittent Failures Robot]

2 failures in 2286 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 2

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2021-12-20&endday=2021-12-26&tree=all

Comment 48

[Ryan VanderMeulen [:RyanVM]]

Attachment: Bug 1707041 - Skip test_ClientEnvironment.js on Android for Beta/Release builds. r=leplatrem

Comment 49

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9f1034e27934
Skip test_ClientEnvironment.js on Android for Beta/Release builds. r=leplatrem

Comment 50

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-release/rev/2efa4eda1059

Comment 51

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/9f1034e27934

Comment 52

[Intermittent Failures Robot]

11 failures in 2801 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 11

Platform and build breakdown:

• android-em-7-0-x86_64-shippable-lite-qr: 6
  • opt: 6
• android-em-7-0-x86_64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1707041&startday=2022-01-03&endday=2022-01-09&tree=all