Closed Bug 931803 Opened 11 years ago Closed 11 years ago

releases_raw doesn't have data after 10-17 (ftpscraper bustage?)

Categories

(Socorro :: General, task)

task
Not set
normal

Tracking

(Not tracked)

VERIFIED FIXED

People

(Reporter: benjamin, Assigned: peterbe)

Details

(Whiteboard: [qa-])

Attachments

(1 file)

44 bytes, text/x-github-pull-request
Details | Review
The releases_raw table, which I believe is populated from ftpscraper, doesn't have nightly builds after 10-17. This makes it hard or impossible to do crashes-per-ADU-per-buildID numbers for bug verifications.

<bsmedberg> KaiRo/selenamarie: aha, the ADU tables are ok, but releases_raw doesn't have the builds after 10-17
<bsmedberg> does that indicate an ftpscraper issue?
<selenamarie> bsmedberg: yup -- i see that ftpscraper has been busted for a couple days as well
<bsmedberg> selenamarie: bug filed or are you on it?
<selenamarie> bsmedberg: i haven't seen any bugs, but would appreciate one or more :)
* bsmedberg will file
<selenamarie> oh awesome: ftpscraper error is --> HTTPError: HTTP Error 404: Not Found
<selenamarie> lol
<selenamarie> sigh

This is urgent for me to do some nightly verifications near today's uplift.
Assignee: nobody → sdeckelmann
Command is: 

(socorro-virtualenv)[socorro@sp-admin01.phx1 application]$ PYTHONPATH=. ../socorro-virtualenv/bin/python socorro/cron/crontabber.py --admin.conf=/etc/socorro/crontabber.ini -j ftpscraper

Confirmed that the error is coming from scraping b2g.
OS: Windows 7 → All
Hardware: x86_64 → All
Attached file Github PR
We should be updated now for Firefox: 

PYTHONPATH=. ../socorro-virtualenv/bin/python socorro/cron/crontabber.py --admin.conf=/etc/socorro/crontabber.ini -j ftpscraper --crontabber.class-FTPScraperCronApp.products=firefox

Most recent nightly in releases_raw is: 20131028040205 | firefox

And I see releases from the 17th through today.

b2g is still broken, with some xml errors. Looking into it with :peterbe.
Finished running backfill for ftpscraper from 10/17->today. 

:bsmedberg -- please have a look and let me know if we are still missing releases.
I now see at least the Windows nightly builds that I expect to see. I didn't examine everything carefully, but I don't see obvious problems.
Whiteboard: [qa-]
Target Milestone: --- → 65
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Assignee: sdeckelmann → peterbe
Bumping to verified as [qa-].
Status: RESOLVED → VERIFIED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: