1767486 - [meta] Migrate remaining browsertime tests to android a51 platform

Status: RESOLVED FIXED

(Testing :: Raptor, task, P2)

Description

[Greg Mierzwinski [:sparky]]

We need to migrate any remaining tests from g5 to the new a51 android platform: https://searchfox.org/mozilla-central/source/taskcluster/ci/test/test-platforms.yml#376-378

Currently, we anticipate needing to migrate the power ones but there could be issues in the migration for android-hw-browsertime tests that spill into here.

Comment 1

[Greg Mierzwinski [:sparky]]

Reminder that we need to handle the cron tasks as well (e.g. general-perf-testing).

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Can we turn off the tests until they get fixed?

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

oh, the live-chrome tests are all blue, I didn't realize there was any work to do here- thanks for calling this out.

:sparky, any concerns with turning off the live-chrome tests on a51?

I see in this log:

task 2022-07-22T12:02:47.746Z] Setting SELinux Permissive
[task 2022-07-22T12:02:47.746Z] 12:01:43     INFO - adb -s RR8R104SS1H logcat -v threadtime Trace:S StrictMode:S ExchangeService:S
[task 2022-07-22T12:02:47.746Z] 12:01:43     INFO - >> Install app: Attempt #1 of 5
[task 2022-07-22T12:02:47.746Z] 12:01:48     INFO - Failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk on a51-06: ADBProcessError args: adb wait-for-device install -r /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk, exitcode: 1, stdout: adb: failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk: Failure [INSTALL_FAILED_VERSION_DOWNGRADE]
[task 2022-07-22T12:02:47.747Z] 12:01:48     INFO - Performing Streamed Install
[task 2022-07-22T12:02:47.747Z] 12:01:48     INFO - Sleeping 10 seconds
[task 2022-07-22T12:02:47.747Z] 12:01:58     INFO - >> Install app: Attempt #2 of 5
[task 2022-07-22T12:02:47.747Z] 12:02:03     INFO - Failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk on a51-06: ADBProcessError args: adb wait-for-device install -r /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk, exitcode: 1, stdout: adb: failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk: Failure [INSTALL_FAILED_VERSION_DOWNGRADE]
[task 2022-07-22T12:02:47.747Z] 12:02:03     INFO - Performing Streamed Install
[task 2022-07-22T12:02:47.747Z] 12:02:03     INFO - Sleeping 10 seconds
[task 2022-07-22T12:02:47.747Z] 12:02:13     INFO - >> Install app: Attempt #3 of 5
[task 2022-07-22T12:02:47.747Z] 12:02:18     INFO - Failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk on a51-06: ADBProcessError args: adb wait-for-device install -r /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk, exitcode: 1, stdout: adb: failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk: Failure [INSTALL_FAILED_VERSION_DOWNGRADE]
[task 2022-07-22T12:02:47.747Z] 12:02:18     INFO - Performing Streamed Install
[task 2022-07-22T12:02:47.747Z] 12:02:18     INFO - Sleeping 10 seconds
[task 2022-07-22T12:02:47.747Z] 12:02:28     INFO - >> Install app: Attempt #4 of 5
[task 2022-07-22T12:02:47.747Z] 12:02:32     INFO - Failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk on a51-06: ADBProcessError args: adb wait-for-device install -r /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk, exitcode: 1, stdout: adb: failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk: Failure [INSTALL_FAILED_VERSION_DOWNGRADE]
[task 2022-07-22T12:02:47.747Z] 12:02:32     INFO - Performing Streamed Install
[task 2022-07-22T12:02:47.747Z] 12:02:32     INFO - Sleeping 10 seconds
[task 2022-07-22T12:02:47.747Z] 12:02:42     INFO - >> Install app: Attempt #5 of 5
[task 2022-07-22T12:02:47.747Z] 12:02:47     INFO - Failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk on a51-06: ADBProcessError args: adb wait-for-device install -r /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk, exitcode: 1, stdout: adb: failed to install /tmp/tmpkueefboy/com.android.chrome-v.87.0.4280.86.apk: Failure [INSTALL_FAILED_VERSION_DOWNGRADE]
[task 2022-07-22T12:02:47.747Z] 12:02:47     INFO - Performing Streamed Install
[task 2022-07-22T12:02:47.747Z] 12:02:47    FATAL - INFRA-ERROR: Failed to install com.android.chrome-v.87.0.4280.86.apk
[task 2022-07-22T12:02:47.747Z] 12:02:47    FATAL - Running post_fatal callback...

Comment 4

[Greg Mierzwinski [:sparky]]

Oh! Thanks for bringing that up :jmaher/:aryx.

I agree, let's disable the chrome live sites on the A51.