1825015 - firefox-android legacy-arm tasks often retried until exception hit because SM-G950F, API Level 28 platform has inconclusive results

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, defect)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

The legacy-arm tasks of the firefox-android repository often get retried or fail with an exception after 5 retries. 3 of 3 such failures investigated had inconclusive results for the SM-G950F, API Level 28 platform (example). Inconclusive results for this platform in its current state should not trigger reruns.

Comment 1

[Johan Lorenzo [:jlorenzo] - On PTO - Back on July 28th]

Transferring NI to :aaronmt. QA owns the UI tests jobs[1]. I'm happy to provide more info if the builds happen to be broken in some way 🙂

[1] https://treeherder.mozilla.org/jobs?repo=firefox-android&revision=c0f9e5d10bb3908bcea3b6d5f55d174f6288d499&selectedTaskRun=LTNnPxVlRVW-yQZQY37A-A.5

Comment 2

[Aaron Train [:aaronmt]]

The SM-G950F dreamlte is high capacity so it's not a queuing issue, but rather an infra problem with the device on Firebase Test Lab. I've posted in their Slack (I see another similar comment there). We can remove the device from the Flank configuration in the next day if need be, but these tests are not blocking.

Config: https://github.com/mozilla-mobile/firefox-android/blob/a586b555b99f044b32fdd70b5cd182b50a6e7534/fenix/automation/taskcluster/androidTest/flank-arm-legacy-api-tests.yml#L46

Comment 3

[Aaron Train [:aaronmt]]

From Firebase Community Slack

Hi Aaron, this appears be an issue with a recent release of Google Play Services (com.google.android.gms) on this particular device. We have an engineer digging deeper into the problem.

No ETA. We can remove the dreamlte in the meantime.

Comment 4

[BMO Github Automation]

Attachment: [mozilla-mobile/firefox-android] Bug 1825015 - Remove dreamlte in legacy test configuration (#1460)

Comment 5

[BMO Github Automation]

Authored by https://github.com/AaronMT
https://github.com/mozilla-mobile/firefox-android/commit/5bfbab24d37489c001da8f63471c3e22f8400a63
[main] Bug 1825015 - Remove dreamlte in legacy test configuration

Comment 6

[Intermittent Failures Robot]

2 failures in 3578 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• firefox-android: 2

Platform and build breakdown:

• AC-ui-test: 1
  • opt: 1
• fenix-ui-test: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1825015&startday=2023-05-15&endday=2023-05-21&tree=all