830989 - Cron Logs Needed To Help Debug... Bug on reps.mozilla.org

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Ben (:bensternthal)]

We are trying to debug bug 826749 and think the production cron logs can help.

Can you provide, either be email or attachment to this bug the cron logs (if they exist).

This is for production reps.mozilla.org.

Comment 1

[Chris Turra [:cturra]]

:bensternthal - i am assuming you're looking for logs from the fetch_bugs runs. looking at the cron configuration stdout is being piped to /dev/null, so we don't have anything historical to provide.

*/5 * * * * root /usr/bin/flock -w 10 /var/lock/reps-prod-bugs /data/engagement/src/reps.mozilla.org/remo/manage.py fetch_bugs > /dev/null


when i manually run this command, i see the following.

[[e-mail]1 remo]# /data/engagement/src/reps.mozilla.org/remo/manage.py fetch_bugs
/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/celery/loaders/default.py:53: NotConfigured: No celeryconfig.py module found! Please make sure it exists and is available to Python.
  NotConfigured)
/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/db/models/fields/__init__.py:808: RuntimeWarning: DateTimeField received a naive datetime (2012-03-16 09:04:00) while time zone support is active.
  RuntimeWarning)
/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/db/models/fields/__init__.py:808: RuntimeWarning: DateTimeField received a naive datetime (2012-05-22 13:41:55) while time zone support is active.
  RuntimeWarning)
/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/db/models/fields/__init__.py:808: RuntimeWarning: DateTimeField received a naive datetime (2012-11-19 01:47:00) while time zone support is active.
  RuntimeWarning)
/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/db/models/fields/__init__.py:808: RuntimeWarning: DateTimeField received a naive datetime (2012-11-22 23:20:03) while time zone support is active.
  RuntimeWarning)
/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/db/models/fields/__init__.py:808: RuntimeWarning: DateTimeField received a naive datetime (2011-08-28 08:25:00) while time zone support is active.
  RuntimeWarning)
/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/db/models/fields/__init__.py:808: RuntimeWarning: DateTimeField received a naive datetime (2012-03-13 14:11:47) while time zone support is active.

.....

Comment 2

[Chris Turra [:cturra]]

:bensternthal - is there more information i can provide here?

Comment 3

[Ben (:bensternthal)]

Nope we are good, rest of the diagnose needs to come from the reps devs.

Comment 4

[Chris Turra [:cturra]]

:bensternthal - thnx for the confirmation.

Comment 5

[Peter Radcliffe [:pir]]

[[e-mail]1 remo]# /data/engagement/src/reps.mozilla.org/remo/manage.py fetch_bugs
/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/celery/loaders/default.py:64: NotConfigured: No 'celeryconfig' module found! Please make sure it exists and is available to Python.
  "is available to Python." % (configname, )))
/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/celery/decorators.py:34: CDeprecationWarning: 
The `celery.decorators` module along with the magic keyword arguments,
are deprecated, and will be removed in version 3.0.

Please use the `celery.task` module instead of `celery.decorators`,
and the `task.request` should be used instead of the magic keyword arguments:

    from celery.task import task

See http://bit.ly/celery22major for more information.


  """))

Traceback (most recent call last):
  File "/data/engagement/src/reps.mozilla.org/remo/manage.py", line 27, in <module>
    manage.main()
  File "/data/engagement/src/reps.mozilla.org/remo/vendor/src/funfactory/funfactory/manage.py", line 143, in main
    execute_manager(current_settings)
  File "/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/core/management/__init__.py", line 459, in execute_manager
    utility.execute()
  File "/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/core/management/__init__.py", line 382, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/core/management/base.py", line 196, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/django/core/management/base.py", line 232, in execute
    output = self.handle(*args, **options)
  File "/data/engagement/src/reps.mozilla.org/remo/remo/remozilla/management/commands/fetch_bugs.py", line 20, in handle
    fetch_bugs(days=options['days'])
  File "/data/engagement/src/reps.mozilla.org/remo/vendor/lib/python/celery/app/task/__init__.py", line 262, in __call__
    return self.run(*args, **kwargs)
  File "/data/engagement/src/reps.mozilla.org/remo/remo/remozilla/tasks.py", line 52, in fetch_bugs
    raise ValueError('Invalid response from server.')
ValueError: Invalid response from server.

Comment 6

[Peter Radcliffe [:pir]]

[[e-mail]1 pradcliffe]# /usr/bin/flock -w 10 /var/lock/reps-stage-bugs /data/engagement-stage/src/reps.allizom.org/remo/manage.py fetch_bugs
/data/engagement-stage/src/reps.allizom.org/remo/vendor/lib/python/celery/loaders/default.py:64: NotConfigured: No 'celeryconfig' module found! Please make sure it exists and is available to Python.
  "is available to Python." % (configname, )))
/data/engagement-stage/src/reps.allizom.org/remo/vendor/lib/python/celery/decorators.py:34: CDeprecationWarning: 
The `celery.decorators` module along with the magic keyword arguments,
are deprecated, and will be removed in version 3.0.

Please use the `celery.task` module instead of `celery.decorators`,
and the `task.request` should be used instead of the magic keyword arguments:

    from celery.task import task

See http://bit.ly/celery22major for more information.


  """))
Traceback (most recent call last):
  File "/data/engagement-stage/src/reps.allizom.org/remo/manage.py", line 27, in <module>
    manage.main()
  File "/data/engagement-stage/src/reps.allizom.org/remo/vendor/src/funfactory/funfactory/manage.py", line 143, in main
    execute_manager(current_settings)
  File "/data/engagement-stage/src/reps.allizom.org/remo/vendor/lib/python/django/core/management/__init__.py", line 459, in execute_manager
    utility.execute()
  File "/data/engagement-stage/src/reps.allizom.org/remo/vendor/lib/python/django/core/management/__init__.py", line 382, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/data/engagement-stage/src/reps.allizom.org/remo/vendor/lib/python/django/core/management/base.py", line 196, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/data/engagement-stage/src/reps.allizom.org/remo/vendor/lib/python/django/core/management/base.py", line 232, in execute
    output = self.handle(*args, **options)
  File "/data/engagement-stage/src/reps.allizom.org/remo/remo/remozilla/management/commands/fetch_bugs.py", line 20, in handle
    fetch_bugs(days=options['days'])
  File "/data/engagement-stage/src/reps.allizom.org/remo/vendor/lib/python/celery/app/task/__init__.py", line 262, in __call__
    return self.run(*args, **kwargs)
  File "/data/engagement-stage/src/reps.allizom.org/remo/remo/remozilla/tasks.py", line 52, in fetch_bugs
    raise ValueError('Invalid response from server.')
ValueError: Invalid response from server.