1122145 - Socorro not picking up Fennec 38.0a1 and 37.0a2

Status: RESOLVED FIXED

(Socorro :: Database, task)

Description

[Robert Helmer [:rhelmer]]

Fennec 37.0a2 and 38.0a1 are posted to FTP but Socorro hasn't picked them up yet.

Comment 1

[Robert Helmer [:rhelmer]]

I think the problem is that update_product_versions() does a join on release_repositories, and looking in releases_raw we're seeing some new entries in the repository column:

mozilla-central-android-x86
mozilla-central-android-api-9
mozilla-central-android-api-11
mozilla-aurora-android-x86
mozilla-aurora-android-api-9
mozilla-aurora-android-api-11

Comment 2

[Robert Helmer [:rhelmer]]

(In reply to Robert Helmer [:rhelmer] from comment #1)
> I think the problem is that update_product_versions() does a join on
> release_repositories, and looking in releases_raw we're seeing some new
> entries in the repository column:
> 
> mozilla-central-android-x86
> mozilla-central-android-api-9
> mozilla-central-android-api-11
> mozilla-aurora-android-x86
> mozilla-aurora-android-api-9
> mozilla-aurora-android-api-11


Kairo - there are multiple builds for nightly and aurora showing up, and Socorro doesn't recognize any of these repositories (which is how it determines which of these buildids should be treated as 38.0a1 in the UI for instance)

Any idea which of these repos we should pick?

Comment 3

[Robert Kaiser]

I know we split Android builds into multiple for different OS versions, that's probably behind this.

Mark, can you help with Rob's questions?

Comment 4

[Mark Finkle (:mfinkle) (use needinfo?)]

I'm not exactly sure what Rob's question is, but yes, we split the APKs into android-api-9 and android-api-11 APKs, starting in Fx37. There is no longer a single adroid ARMv7 APK.

What other details can we provide to help out?

CC'ing Richard and Justin to be around for any followup questions.

Comment 5

[Robert Kaiser]

The question is which of those APKs should determine which build IDs and versions we should look up on FTP to be able to determine which FennecAndroid versions exist.

Comment 6

[Richard Newman [:rnewman]]

I believe the build IDs and versions should be the same; these will be two jobs triggered from the same revision at the same time.

ftp://ftp.mozilla.org/pub/mobile/nightly/latest-mozilla-aurora-android-api-11/fennec-37.0a2.multi.android-arm.json

and

ftp://ftp.mozilla.org/pub/mobile/nightly/latest-mozilla-aurora-android-api-9/fennec-37.0a2.multi.android-arm.json

have the same build ID.

(The real answer is "every APK", but you can settle for just looking at one.)

Comment 7

[Robert Kaiser]

If we go for one, I think going for the api-11 is probably better as it's the newer platform.

Comment 8

[Robert Helmer [:rhelmer]]

OK thanks, this answers my question.

Comment 9

[[github robot]]

Commits pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/362a7fb9ac3c790788d48cd48b148edca15b0ae4
Fixes bug 1122145 - add fennec repos to table

https://github.com/mozilla/socorro/commit/f64b3677d4649deb3db39b80c1e672c14d48a885
Merge pull request #2580 from selenamarie/bug1122145-add-release-repos-for-fennec

Fixes bug 1122145 - add fennec repos to table

Comment 10

[Robert Helmer [:rhelmer]]

The fix for this will be pushed to production shortly.

Comment 11

[Robert Helmer [:rhelmer]]

This is in production and these new releases should show up when reports are generated early tomorrow morning.

Comment 12

[Aaron Train [:aaronmt]]

Still not seeing Fennec 38 on crash-stats (at least on this canonical URL https://crash-stats.mozilla.com/topcrasher/products/FennecAndroid/versions/38.0a1). Can we double check here?

Comment 13

[Aaron Train [:aaronmt]]

(In reply to Aaron Train [:aaronmt] from comment #12)
> Still not seeing Fennec 38 on crash-stats (at least on this canonical URL
> https://crash-stats.mozilla.com/topcrasher/products/FennecAndroid/versions/
> 38.0a1). Can we double check here?

Ditto 37.0a2

Comment 14

[Robert Helmer [:rhelmer]]

FennecAndroid 37.0a2 and 38.0a1 still aren't showing up in product_versions, I'll take a look too

Comment 15

[Robert Helmer [:rhelmer]]

There's also a special_product_platforms table, since this product has a different name in the ftp metadata ("mobile") and in the UI ("FennecAndroid"). It also has a "repository" column that needs to be updated.

Comment 16

[[github robot]]

Commits pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/6fae9ed2964f114746aa287bc9fd1ee9e33e053b
Fixes bug 1122145 add fennec release repos to special_product_platforms

https://github.com/mozilla/socorro/commit/5294ec2c1e57cd8238e789af6dfbe7bd5e62f7b0
Merge pull request #2587 from selenamarie/bug1122145-fennec-join-table-update

Fixes bug 1122145 add fennec release repos to special_product_platforms

Comment 17

[Mark Finkle (:mfinkle) (use needinfo?)]

When should we start to see data for Fennec 38.0a1 and Fennec 37.0a2 show up on the dashboard?

Comment 18

[Robert Helmer [:rhelmer]]

(In reply to Mark Finkle (:mfinkle) from comment #17)
> When should we start to see data for Fennec 38.0a1 and Fennec 37.0a2 show up
> on the dashboard?

This fix is going out this morning, I should be able to backfill so it'll show up today.

Comment 19

[Robert Helmer [:rhelmer]]

Fix is pushed to production, and the new versions are showing up now.

I am backfilling reports for the 13th to the 20th so there should be data there too in the next few hours, will update this bug when it's ready.

Comment 20

[Robert Helmer [:rhelmer]]

(In reply to Robert Helmer [:rhelmer] from comment #19)
> Fix is pushed to production, and the new versions are showing up now.
> 
> I am backfilling reports for the 13th to the 20th so there should be data
> there too in the next few hours, will update this bug when it's ready.

Took a bit longer than expected, but we have data for the last week now too:
https://crash-stats.mozilla.com/home/products/FennecAndroid