Closed Bug 832083 Opened 12 years ago Closed 11 years ago

add support for b2g-style json manifest files to ftpscraper

Categories

(Socorro :: Backend, task)

task
Not set
normal

Tracking

(Not tracked)

VERIFIED FIXED

People

(Reporter: rhelmer, Assigned: rhelmer)

References

Details

Attachments

(2 files)

Needed for bug 821989
Depends on: 832074
Assignee: rhelmer → sdeckelmann
Summary: add support for b2g-style XML manifest files to ftpscraper → add support for b2g-style json manifest files to ftpscraper
New file format example: 

http://ftp.mozilla.org/pub/mozilla.org/b2g/manifests/2013-01-25-07/socorro_unagi_2013-01-25-07.json

{"buildid": "20130125070201", "update_channel": "nightly", "version": "18.0"}
Target Milestone: --- → 36
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
rhelmer: can you suggest minimal steps for QA to test this or is this [qa-] until bug 821989 lands?
Sample of recent inserts into the releases_raw table: 

psql> select * from releases_raw order by build_id desc limit 10;

-[ RECORD 1 ]+-----------------------
product_name | b2g
version      | 18.0
platform     | mac64-localizer
build_id     | 20130227070202
build_type   | Nightly
beta_number  | 
repository   | mozilla-b2g18
-[ RECORD 2 ]+-----------------------
product_name | b2g
version      | 18.0
platform     | win32-localizer
build_id     | 20130227070202
build_type   | Nightly
beta_number  | 
repository   | mozilla-b2g18
Attached image qa - verified on stage
QA verifed on stage -  thank you Selena for helping unravel the thread on where to look.

https://crash-stats.allizom.org/products/B2G/builds
Status: RESOLVED → VERIFIED
This was not ported to crontabber FTPScraper, need that for rapid beta support for B2G :)
Status: VERIFIED → REOPENED
Resolution: FIXED → ---
Target Milestone: 36 → 42
Work on this is underway.
Commits pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/c6fabc99983318da960b18cb5ddb3d72d56d76a8
bug 832083 - update ftpscraper b2g code to support crontabber

Thanks, @peterbe for a great review!

https://github.com/mozilla/socorro/commit/8f1ea30c6c283de59fb0eea5b593fa93e8c2d628
Merge pull request #1178 from selenamarie/832083-scraper-to-crontabber

bug 832083 - update ftpscraper b2g code to support crontabber
Status: REOPENED → RESOLVED
Closed: 12 years ago11 years ago
Resolution: --- → FIXED
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Target Milestone: 42 → 43
Going to follow up on this.
Assignee: sdeckelmann → rhelmer
This seems to be working fine, I think the current problem is further along in the process (see bug 864896)
Status: REOPENED → RESOLVED
Closed: 11 years ago11 years ago
Resolution: --- → FIXED
(In reply to Robert Helmer [:rhelmer] from comment #13)
> This seems to be working fine, I think the current problem is further along
> in the process (see bug 864896)

rhelmer, thanks for investigating and opening bug 864896 for the B2G/builds.

QA verified https://crash-stats.allizom.org/products/Firefox/builds is now populated.
Status: RESOLVED → VERIFIED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: