617957 - support-stage 500 apache error and logs aren't working

Status: VERIFIED FIXED

(mozilla.org Graveyard :: Server Operations, task)

Description

[James Socol [:jsocol, :james]]

support-stage is returning Apache-style 500 errors, which means something is wrong too far up/down for Django to send us email, and since yesterday, only celery logs are showing up on cm-vpn01 (that's probably a code issue so if you can help me figure out what's wrong I'll fix it :)

Anyway, we have a release today, and QA needs this server to work to verify bugs beforehand.

Comment 1

[Derek Moore [:dmoore]]

Attachment: support-stage error

See attached error log

Comment 2

[Derek Moore [:dmoore]]

settings_default exists and appears valid

[root@mrapp-stage04 support.mozilla.org]# cd /data/www/support-stage-new.mozilla.com/kitsune/vendor/src/django-mozilla-product-details/product_details/

[root@mrapp-stage04 product_details]# ls -al settings_defaults.py
-rw-r--r-- 1 root root 338 Sep 22 16:40 settings_defaults.py

Comment 3

[Derek Moore [:dmoore]]

Attachment: support-stage error

Proper error message

Comment 4

[James Socol [:jsocol, :james]]

I've never seen product-details throw that error before. What happens if you try `python26 manage.py shell` from the kitsune directory?

Comment 5

[Derek Moore [:dmoore]]

No errors from the shell, bouncing over to fox2mike for special attention.

Comment 6

[Shyam Mani [:fox2mike]]

Yeah, nothing from the shell.

[root@mrapp-stage04 kitsune]# python26 manage.py shell
Python 2.6.2 (r262:71600, Aug 26 2009, 21:59:15) 
Type "copyright", "credits" or "license" for more information.

IPython 0.10 -- An enhanced Interactive Python.
?         -> Introduction and overview of IPython's features.
%quickref -> Quick reference.
help      -> Python's own help system.
object?   -> Details about 'object'. ?object also works, ?? prints more.

In [1]:

Comment 7

[Shyam Mani [:fox2mike]]

Rechecking out the vendor lib fixed this.

Comment 8

[James Socol [:jsocol, :james]]

Thanks Shyam!