1655538 - Perma fenix browsertime failures

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P3)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Push: https://treeherder.mozilla.org/#/jobs?repo=fenix&group_state=expanded&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&searchStr=browsertime&revision=5a4c391b529c8a0d962f97d9f75e53816841fe1b

Log: https://treeherder.mozilla.org/logviewer.html#?job_id=311165567&repo=fenix

[task 2020-07-27T18:22:04.120Z] 18:21:25 INFO - raptor-browsertime Info: Run tests on Moto G (5) using Android version 7.0
[task 2020-07-27T18:22:04.120Z] 18:21:25 INFO - raptor-browsertime Info: Running tests using Firefox - 15 iteration(s)
[task 2020-07-27T18:22:04.120Z] 18:21:26 INFO - raptor-browsertime Info: Browser failed to start, trying 2 more time(s): binary is not a Firefox executable
[task 2020-07-27T18:22:04.120Z] 18:21:27 INFO - raptor-browsertime Info: Browser failed to start, trying 1 more time(s): binary is not a Firefox executable
[task 2020-07-27T18:22:04.120Z] 18:21:28 INFO - raptor-browsertime Info: Browser failed to start, trying 0 more time(s): binary is not a Firefox executable

Comment 1

[Greg Mierzwinski [:sparky]]

Looking into it right now. It's unclear what might have caused this - I'm starting to suspect it's a product issue.

Comment 2

[Greg Mierzwinski [:sparky]]

Ok so this should be fixed tomorrow, I think it came from the bad geckodriver that resulted in this backout: https://treeherder.mozilla.org/#/jobs?repo=autoland&tier=1%2C2%2C3&searchStr=browsertime&revision=60eaf4ad2113d86b874868827d710bc08d4b6435

Comment 3

[Greg Mierzwinski [:sparky]]

Failure most likely caused by bug 1648964

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1648964

Comment 5

[Greg Mierzwinski [:sparky]]

This is fixed now, it was caused by a faulty geckodriver being used from autoland.