933924 - Version ordering for Firefox 24 incorrectly places beta versions

Status: RESOLVED WONTFIX

(Socorro :: Webapp, task)

Description

[Stephen Donner [:stephend] Not actively reading bugmail]

Attachment: version-order.png

Right now on staging, we have the following order in the "Versions" dropdown for Firefox:

24.0b
24.0
24.0b10

According to our tests + Kairo, they should be:

24.0
24.0b
24.0b10

Our automation caught it:

http://qa-selenium.mv.mozilla.com:8080/view/Socorro/job/socorro.stage.saucelabs/401/HTML_Report/?

https://github.com/mozilla/Socorro-Tests/blob/master/tests/test_layout.py#L33

Comment 1

[Stephen Donner [:stephend] Not actively reading bugmail]

BTW, this last passed our automation, http://qa-selenium.mv.mozilla.com:8080/job/socorro.stage.saucelabs/400/, on Oct 31, 2013 4:10:06 PM.

Started failing with this build:

http://qa-selenium.mv.mozilla.com:8080/job/socorro.stage.saucelabs/401/ - just 24 minutes later:  (Oct 31, 2013 4:34:45 PM)

Comment 2

[Stephen Donner [:stephend] Not actively reading bugmail]

:rhelmer, would you be up for taking a look, given that you've fixed this in the past?

Comment 3

[Robert Helmer [:rhelmer]]

(In reply to Stephen Donner [:stephend] from comment #2)
> :rhelmer, would you be up for taking a look, given that you've fixed this in
> the past?

sure

Comment 4

[Stephen Donner [:stephend] Not actively reading bugmail]

BTW, this hit prod too.

Comment 5

[Stephen Donner [:stephend] Not actively reading bugmail]

Apologies for putting in milestone 65, but I'd hate to see us defer/xfail a "simple" fix like this, further.

Comment 7

[[:AndreiH]]

I guess there's not need for this, since 24.0b is not in the Current Versions list anymore and the test passes

Comment 8

[Stephen Donner [:stephend] Not actively reading bugmail]

(In reply to AndreiH from comment #7)
> I guess there's not need for this, since 24.0b is not in the Current
> Versions list anymore and the test passes

No; this will undoubtedly crop up again, so we should fix it.  We can mock the conditions/data from before to fix and re-test.

Comment 9

[Robert Kaiser]

Yes, right now it's 26.0b and starting this week it will be 27.0b

Comment 10

[Matt Brandt [:mbrandt]]

Removing [previous & old] target milestone since this is still awaiting a fix

Comment 11

[Robert Helmer [:rhelmer]]

I am not currently working on this, stephend still happening?

Comment 12

[Stephen Donner [:stephend] Not actively reading bugmail]

(In reply to Robert Helmer [:rhelmer] from comment #11)
> I am not currently working on this, stephend still happening?

Yes, this still happens; attaching a screenshot from staging, where it's currently:

40.0b
40.0
40.0b99
40.0b9
...

where it probably should be:

40.0
40.0b
40.0b9
40.0b99
...

Comment 13

[Stephen Donner [:stephend] Not actively reading bugmail]

Attachment: socorro-versions.png

Comment 14

[Stephen Donner [:stephend] Not actively reading bugmail]

(Also, our automation doesn't bother testing for this any longer - the test was removed in https://github.com/mozilla/Socorro-Tests/issues/309 and https://github.com/tccharles/Socorro-Tests/commit/2756c1158d27c47a0b2690864338ddfa1c957dd8.)

Comment 15

[Matt Brandt [:mbrandt]]

Just a note: we discussed removing order based tests from the functional UI test cases in favor of coding the test cases into a lower level unit/integration test.

Comment 16

[Lonnen :lonnen]

The lone and level sands stretch far away.