Created attachment 826071 [details] version-order.png Right now on staging, we have the following order in the "Versions" dropdown for Firefox: 24.0b 24.0 24.0b10 According to our tests + Kairo, they should be: 24.0 24.0b 24.0b10 Our automation caught it: http://qa-selenium.mv.mozilla.com:8080/view/Socorro/job/socorro.stage.saucelabs/401/HTML_Report/? https://github.com/mozilla/Socorro-Tests/blob/master/tests/test_layout.py#L33
BTW, this last passed our automation, http://qa-selenium.mv.mozilla.com:8080/job/socorro.stage.saucelabs/400/, on Oct 31, 2013 4:10:06 PM. Started failing with this build: http://qa-selenium.mv.mozilla.com:8080/job/socorro.stage.saucelabs/401/ - just 24 minutes later: (Oct 31, 2013 4:34:45 PM)
:rhelmer, would you be up for taking a look, given that you've fixed this in the past?
(In reply to Stephen Donner [:stephend] from comment #2) > :rhelmer, would you be up for taking a look, given that you've fixed this in > the past? sure
BTW, this hit prod too.
Apologies for putting in milestone 65, but I'd hate to see us defer/xfail a "simple" fix like this, further.
I guess there's not need for this, since 24.0b is not in the Current Versions list anymore and the test passes
(In reply to AndreiH from comment #7) > I guess there's not need for this, since 24.0b is not in the Current > Versions list anymore and the test passes No; this will undoubtedly crop up again, so we should fix it. We can mock the conditions/data from before to fix and re-test.
Yes, right now it's 26.0b and starting this week it will be 27.0b
Removing [previous & old] target milestone since this is still awaiting a fix
I am not currently working on this, stephend still happening?
(In reply to Robert Helmer [:rhelmer] from comment #11) > I am not currently working on this, stephend still happening? Yes, this still happens; attaching a screenshot from staging, where it's currently: 40.0b 40.0 40.0b99 40.0b9 ... where it probably should be: 40.0 40.0b 40.0b9 40.0b99 ...
(Also, our automation doesn't bother testing for this any longer - the test was removed in https://github.com/mozilla/Socorro-Tests/issues/309 and https://github.com/tccharles/Socorro-Tests/commit/2756c1158d27c47a0b2690864338ddfa1c957dd8.)
Just a note: we discussed removing order based tests from the functional UI test cases in favor of coding the test cases into a lower level unit/integration test.
The lone and level sands stretch far away.