1892902 - Intermittent raptor-browsertime Error: Browsertime failed to run | raptor-browsertime Critical: Could not single click on element with selector #suites > ul > li:nth-child(2) > label > input[type="checkbox"]

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: pstanciu [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=455495374&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RN8VNQChRLC2rYw_NumDow/runs/0/artifacts/public/logs/live_backing.log

---

[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.194Z adb:command Send '000Chost:devices'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.198Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.199Z adb:command Send '001Cshell:echo $EXTERNAL_STORAGE'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.232Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.233Z adb:command Send '001Cshell:dumpsys window windows'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.311Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.312Z adb:command Send '001Bshell:svc power stayon true'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.325Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.326Z adb:command Send '001Eshell:getprop ro.product.model'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.368Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.368Z adb:command Send '001Dshell:getprop ro.product.name'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.426Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.979Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.426Z adb:command Send '001Fshell:getprop ro.product.device'
[task 2024-04-23T08:55:03.980Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.474Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.980Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.474Z adb:command Send '0019shell:getprop ro.serialno'
[task 2024-04-23T08:55:03.980Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.519Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.980Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.520Z adb:command Send '0038shell:dumpsys netstats | grep -E 'iface=wlan.*networkId''
[task 2024-04-23T08:55:03.980Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.766Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.980Z] 08:54:04     INFO -  raptor-browsertime Info: 2024-04-23T08:54:04.767Z adb:command Send '0027shell:getprop ro.build.version.release '
[task 2024-04-23T08:55:03.980Z] 08:54:04     INFO -  raptor-browsertime Info: Run tests on SM-A515F [R58R417Q4JT] using Android version 11
[task 2024-04-23T08:55:03.980Z] 08:54:04     INFO -  raptor-browsertime Info: Running tests using Firefox - 1 iteration(s)
[task 2024-04-23T08:55:03.980Z] 08:54:04     INFO -  raptor-browsertime Info: Skip setting default preferences for Firefox
[task 2024-04-23T08:55:03.980Z] 08:54:28     INFO -  raptor-browsertime Info: 2024-04-23T08:54:28.573Z adb:command Send '001Ahost:transport:R58R417Q4JT'
[task 2024-04-23T08:55:03.980Z] 08:54:28     INFO -  raptor-browsertime Info: 2024-04-23T08:54:28.574Z adb:command Send '0040shell:dumpsys battery | grep temperature | grep -Eo '[0-9]{1,3}''
[task 2024-04-23T08:55:03.980Z] 08:54:28     INFO -  raptor-browsertime Info: Starting MotionMark 1.3 test
[task 2024-04-23T08:55:03.980Z] 08:54:28     INFO -  raptor-browsertime Info: Waiting for 20000 ms (post_startup_delay)
[task 2024-04-23T08:55:03.980Z] 08:54:48     INFO -  raptor-browsertime Info: Navigating to about:blank
[task 2024-04-23T08:55:03.980Z] 08:54:48     INFO -  raptor-browsertime Info: Navigating to url about:blank iteration 1
[task 2024-04-23T08:55:03.980Z] 08:54:55     INFO -  raptor-browsertime Info: Cycle 0, waiting for 1000 ms
[task 2024-04-23T08:55:03.980Z] 08:54:56     INFO -  raptor-browsertime Info: Cycle 0, starting the measure
[task 2024-04-23T08:55:03.980Z] 08:54:56     INFO -  raptor-browsertime Info: Testing url http://127.0.0.1:54845/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance iteration 1
[task 2024-04-23T08:55:03.980Z] 08:55:02     INFO -  raptor-browsertime Info: CPU / Power usage: 3041
[task 2024-04-23T08:55:11.940Z] 08:55:03    ERROR -  raptor-browsertime Error: Browsertime failed to run
[task 2024-04-23T08:55:11.940Z] 08:55:03 CRITICAL -  raptor-browsertime Critical: Could not single click on element with selector #suites > ul > li:nth-child(2) > label > input[type="checkbox"]
[task 2024-04-23T08:55:11.940Z] 08:55:03     INFO -  raptor-browsertime-android Info: removing reverse socket connections
[task 2024-04-23T08:55:11.941Z] 08:55:04    ERROR -  Traceback (most recent call last):
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -    File "/builds/task_171386232901378/workspace/build/tests/raptor/raptor/raptor.py", line 188, in <module>
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -      main()
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -    File "/builds/task_171386232901378/workspace/build/tests/raptor/raptor/raptor.py", line 137, in main
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -      success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -    File "/builds/task_171386232901378/workspace/build/tests/raptor/raptor/browsertime/android.py", line 271, in run_tests
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -      return super(BrowsertimeAndroid, self).run_tests(tests, test_names)
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -    File "/builds/task_171386232901378/workspace/build/tests/raptor/raptor/perftest.py", line 499, in run_tests
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -      self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -    File "/builds/task_171386232901378/workspace/build/tests/raptor/raptor/browsertime/base.py", line 1051, in run_test
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -      raise Exception(self.browsertime_failure)
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO -  Exception: Could not single click on element with selector #suites > ul > li:nth-child(2) > label > input[type="checkbox"]
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - Return code: 1
[task 2024-04-23T08:55:11.941Z] 08:55:04  WARNING - setting return code to 1
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - Killing logcat pid 801.
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - Copying Raptor results to upload dir:
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - /builds/task_171386232901378/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - Copying raptor results from /builds/task_171386232901378/workspace/build/raptor.json to /builds/task_171386232901378/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2024-04-23T08:55:11.941Z] 08:55:04 CRITICAL - Error copying results /builds/task_171386232901378/workspace/build/raptor.json to upload dir /builds/task_171386232901378/workspace/build/blobber_upload_dir/perfherder-data.json
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - [Errno 2] No such file or directory: '/builds/task_171386232901378/workspace/build/raptor.json'
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - Running post-action listener: _package_coverage_data
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - Running post-action listener: _resource_record_post_action
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - Running post-action listener: process_java_coverage_data
[task 2024-04-23T08:55:11.941Z] 08:55:04     INFO - Running post-action listener: stop_device
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - Killing logcat pid 801.
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - [mozharness: 2024-04-23 08:55:06.761065Z] Finished run-tests step (success)
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - Running post-run listener: _resource_record_post_run
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - Total resource usage - Wall time: 91s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - TinderboxPrint: I/O read bytes / time<br/>0 / 0
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - TinderboxPrint: I/O write bytes / time<br/>0 / 0
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - install-chrome-android - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - install-chromium-distribution - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - install - Wall time: 14s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-04-23T08:55:11.941Z] 08:55:06     INFO - run-tests - Wall time: 74s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2024-04-23T08:55:11.941Z] 08:55:06  WARNING - returning nonzero exit status 1
[task 2024-04-23T08:55:11.941Z] cleanup
[task 2024-04-23T08:55:11.941Z] + cleanup
[task 2024-04-23T08:55:11.941Z] + local rv=1
[task 2024-04-23T08:55:11.941Z] + [[ -s /builds/worker/.xsession-errors ]]
[task 2024-04-23T08:55:11.941Z] + '[' ']'
[task 2024-04-23T08:55:11.941Z] + false
[task 2024-04-23T08:55:11.941Z] + exit 1
[task 2024-04-23T08:55:11.941Z] script.py: command finished
[task 2024-04-23T08:55:11.941Z] command_output: adb kill-server, timeout: None, timedout: None, exitcode: 0, output: 
[task 2024-04-23T08:55:12.009Z] 
[task 2024-04-23T08:55:12.010Z] netstat -aop
[task 2024-04-23T08:55:12.010Z] Active Internet connections (servers and established)
[task 2024-04-23T08:55:12.010Z] Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name     Timer
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:43541         0.0.0.0:*               LISTEN      1170/geckodriver     off (0.00/0/0)
[task 2024-04-23T08:55:12.010Z] tcp        0      0 127.0.0.11:34005        0.0.0.0:*               LISTEN      -                    off (0.00/0/0)
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:8099          0.0.0.0:*               LISTEN      58/taskcluster-prox  off (0.00/0/0)
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:5037          localhost:60683         TIME_WAIT   -                    timewait (53.15/0/0)
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:43541         localhost:55464         TIME_WAIT   -                    timewait (50.72/0/0)
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:43541         localhost:39844         TIME_WAIT   -                    timewait (36.94/0/0)
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:43541         localhost:55472         TIME_WAIT   -                    timewait (50.76/0/0)
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:43541         localhost:55798         TIME_WAIT   -                    timewait (51.91/0/0)
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:5037          localhost:42065         TIME_WAIT   -                    timewait (52.21/0/0)
<...>
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:5037          localhost:57067         TIME_WAIT   -                    timewait (54.66/0/0)
[task 2024-04-23T08:55:12.010Z] tcp        0      0 localhost:5037          localhost:35763         TIME_WAIT   -                    timewait (52.54/0/0)
[task 2024-04-23T08:55:12.010Z] tcp6       0      0 [::]:60098              [::]:*                  LISTEN      50/livelog           off (0.00/0/0)
[task 2024-04-23T08:55:12.010Z] tcp6       0      0 [::]:60099              [::]:*                  LISTEN      50/livelog           off (0.00/0/0)
[task 2024-04-23T08:55:12.010Z] tcp6       0      0 127.0.0.1:60098         127.0.0.1:40042         ESTABLISHED 50/livelog           keepalive (6.98/0/0)
[task 2024-04-23T08:55:12.010Z] udp        0      0 127.0.0.11:34954        0.0.0.0:*                           -                    off (0.00/0/0)
[task 2024-04-23T08:55:12.010Z] Active UNIX domain sockets (servers and established)
[task 2024-04-23T08:55:12.010Z] Proto RefCnt Flags       Type       State         I-Node   PID/Program name     Path
[task 2024-04-23T08:55:12.010Z] 
[task 2024-04-23T08:55:12.010Z] 
[task 2024-04-23T08:55:12.016Z] 
[task 2024-04-23T08:55:12.017Z] 
[task 2024-04-23T08:55:12.017Z] df -h
[task 2024-04-23T08:55:12.017Z] Filesystem      Size  Used Avail Use% Mounted on
[task 2024-04-23T08:55:12.017Z] overlay         458G  125G  310G  29% /
[task 2024-04-23T08:55:12.017Z] tmpfs            64M     0   64M   0% /dev
[task 2024-04-23T08:55:12.017Z] tmpfs           7.8G     0  7.8G   0% /sys/fs/cgroup
[task 2024-04-23T08:55:12.017Z] shm              64M     0   64M   0% /dev/shm
[task 2024-04-23T08:55:12.017Z] /dev/sda1       458G  125G  310G  29% /test
[task 2024-04-23T08:55:12.017Z] tmpfs           7.8G     0  7.8G   0% /proc/acpi
[task 2024-04-23T08:55:12.017Z] tmpfs           7.8G     0  7.8G   0% /proc/scsi
[task 2024-04-23T08:55:12.017Z] tmpfs           7.8G     0  7.8G   0% /sys/firmware
[task 2024-04-23T08:55:12.017Z] 
[task 2024-04-23T08:55:12.017Z] 
[task 2024-04-23T08:55:12.017Z] 
[task 2024-04-23T08:55:12.017Z] script.py: exiting with exitcode 1.
[taskcluster 2024-04-23T08:55:12.045Z]    Exit Code: 1
[taskcluster 2024-04-23T08:55:12.045Z]    User Time: 53.599678s
[taskcluster 2024-04-23T08:55:12.045Z]  Kernel Time: 12.564638s
[taskcluster 2024-04-23T08:55:12.045Z]    Wall Time: 3m1.883900767s
[taskcluster 2024-04-23T08:55:12.045Z]       Result: FAILED
[taskcluster 2024-04-23T08:55:12.045Z] === Task Finished ===
[taskcluster 2024-04-23T08:55:12.045Z] Task Duration: 3m1.88733951s
[taskcluster 2024-04-23T08:55:12.097Z] Uploading artifact public/logs/localconfig.json from file workspace/logs/localconfig.json with content encoding "gzip", mime type "application/json" and expiry 2024-07-22T04:12:19.829Z
[taskcluster 2024-04-23T08:55:12.382Z] Uploading artifact public/test_info/logcat-R58R417Q4JT.log from file workspace/build/blobber_upload_dir/logcat-R58R417Q4JT.log with content encoding "gzip", mime type "text/plain" and expiry 2024-07-22T04:12:19.829Z
[taskcluster 2024-04-23T08:55:12.794Z] Uploading artifact public/test_info/profile_resource-usage.json from file workspace/build/blobber_upload_dir/profile_resource-usage.json with content encoding "gzip", mime type "application/json" and expiry 2024-07-22T04:12:19.829Z
[taskcluster 2024-04-23T08:55:13.048Z] Uploading artifact public/test_info/resource-usage.json from file workspace/build/blobber_upload_dir/resource-usage.json with content encoding "gzip", mime type "application/json" and expiry 2024-07-22T04:12:19.829Z
[taskcluster 2024-04-23T08:55:13.303Z] Uploading redirect artifact public/logs/live.log to URL https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RN8VNQChRLC2rYw_NumDow/runs/0/artifacts/public%2Flogs%2Flive_backing.log with mime type "text/plain; charset=utf-8" and expiry 2024-07-22T04:12:19.829Z
[taskcluster:error] exit status 1

Comment 1

[Intermittent Failures Robot]

1 failures in 4336 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-a51-11-0-aarch64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1892902&startday=2024-04-22&endday=2024-04-28&tree=all

Comment 2

[BugBot [:suhaib / :marco]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 3

[Treeherder Bug Filer]

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=493411956&repo=mozilla-central

Comment 4

[Intermittent Failures Robot]

Summary

1 failures in 4309 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• android-hw-a55-14-0-aarch64: 1
  • opt: 1

Table

	nofis
android-hw-a55-14-0-aarch64--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1892902&startday=2025-02-03&endday=2025-02-09&tree=all

Comment 5

[Intermittent Failures Robot]

Summary

1 failures in 4340 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1470-64: 1
  • opt: 1

Table

	no_variant
macosx1470-64--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1892902&startday=2025-02-17&endday=2025-02-23&tree=all

Comment 6

[BugBot [:suhaib / :marco]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Comment 7

[Intermittent Failures Robot]

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
macosx1400-64-qr--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1892902&startday=2025-03-24&endday=2025-03-30&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Table

	no_variant
android-aarch64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1892902&startday=2025-09-08&endday=2025-09-14&tree=all

Comment 9

[Intermittent Failures Robot]

2 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Table

	nofis
android-aarch64/opt	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1892902&startday=2025-09-22&endday=2025-09-28&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Table

	nofis
android-aarch64/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1892902&startday=2025-12-01&endday=2025-12-07&tree=all