[ReMo] fetch_bugs cron is not running

RESOLVED FIXED

Status

Infrastructure & Operations Graveyard
WebOps: Engagement
RESOLVED FIXED
3 years ago
2 years ago

People

(Reporter: tasos, Assigned: cyliang)

Tracking

Details

(Whiteboard: [kanban:https://webops.kanbanize.com/ctrl_board/2/1281] )

(Reporter)

Description

3 years ago
Hi,

It looks like fetch_bugs cronjob is not working as expected in the production server. 

Could you please check if fetch_bugs cronjob is running in reps.mozilla.org?

Thanks!

Updated

3 years ago
Whiteboard: [kanban:https://webops.kanbanize.com/ctrl_board/2/1281]
(Assignee)

Updated

3 years ago
Assignee: server-ops-webops → cliang
(Assignee)

Comment 1

3 years ago
Three questions:

   1.  How do you verify if the fetch_bugs cronjob has run correctly?
   2.  Does the fetch_bugs cron job normally produce any output?  
   3.  Is the fetch_bugs cron job for dev (reps-dev.allizom.org) working?

The fetch_bugs job looks like it is normally invoked via flock which suppresses output.  If I temporarily disable the cron job and run that job manually, I get some warnings, but no output:

# /data/genericrhel6/src/reps.mozilla.org/remo/manage.py fetch_bugs
/data/genericrhel6/src/reps.mozilla.org/remo/vendor-local/lib/python/pytz/__init__.py:35: UserWarning: Module django was already imported from /data/genericrhel6/src/reps.mozilla.org/remo/vendor-local/src/django/django/__init__.pyc, but /data/genericrhel6/src/reps.mozilla.org/remo/vendor/lib/python is being added to sys.path
  from pkg_resources import resource_stream
/data/genericrhel6/src/reps.mozilla.org/remo/vendor-local/lib/python/pytz/__init__.py:35: UserWarning: Module celery was already imported from /data/genericrhel6/src/reps.mozilla.org/remo/vendor/lib/python/celery/__init__.pyc, but /usr/lib/python2.6/site-packages is being added to sys.path
  from pkg_resources import resource_stream
/data/genericrhel6/src/reps.mozilla.org/remo/vendor-local/lib/python/pytz/__init__.py:35: UserWarning: Module djcelery was already imported from /data/genericrhel6/src/reps.mozilla.org/remo/vendor/lib/python/djcelery/__init__.pyc, but /usr/lib/python2.6/site-packages is being added to sys.path
  from pkg_resources import resource_stream
(Reporter)

Comment 2

3 years ago
1. fetch_bugs is responsible for fetching some bugs from Bugzilla related to the ReMo product and saving them in the database. Upon successful termination, fetch_bugs updates an entry in the database with a time stamp. 

2. No output is produced.

3. According to the time stamps, fetch_bugs seems to be working OK for both dev and stage servers.
(Reporter)

Comment 3

3 years ago
Is there any update regarding the status of fetch_bugs script? I don't know if this is relevant, but we recently had an issue with fetch_bugs described in this bug [0].

[0] https://bugzilla.mozilla.org/show_bug.cgi?id=1147009
(Assignee)

Comment 4

3 years ago
I've forcibly re-created the flock file.  Please let me know if you see any bugs being updated and/or what an updated database entry might look like.

/var/log/cron shows that the cron job has been run since I re-created the lock file.  However, it's been showing similar entries since Apr 27th, so its difficult to verify if anything has changed.
(Reporter)

Comment 5

3 years ago
Everything looks good. The database has a new entry every 15 minutes with a new timestamp from a successful run of fetch_bugs. I am going to leave this bug open for a couple more days to monitor fetch_bugs and report any updates here. Thanks!
(Reporter)

Comment 6

3 years ago
Fetch_bugs is running OK for three days now. Marking this bug as resolved. Thanks!
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.