ftp3 ftp logs named wrong and not ingested

RESOLVED FIXED

Status

mozilla.org Graveyard
Server Operations
--
major
RESOLVED FIXED
6 years ago
3 years ago

People

(Reporter: ericz, Assigned: ericz)

Tracking

Details

(Assignee)

Description

6 years ago
ftp.mozilla.org logs from ftp3.dmz.scl3 did not follow the naming convention and thus were not being ingested by metrics.  The names need to be fixed and then the logs need to be backfilled into HDFS.
(Assignee)

Updated

6 years ago
Severity: normal → major
(Assignee)

Comment 1

6 years ago
None of the ftp logs were named as aphadke was looking for.  Changing log names via apache config in puppet.
(Assignee)

Comment 2

6 years ago
The situation turned out to be a bit more complicated.  One, we should've been grabbing or ingesting the logs in question.  The fetch-logs.sh script on metrics-logger1 has been updated to only get releases.mozilla.com logs, which are the only ones we want to get directly from the FTP servers (everything else should be from Zeus).

As per aphadke the names of the releases.m.c logs are ok as he has a special case for them.  Therefore there is no naming problem now and the extraneous logs will no longer be ingested.
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.