If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

support-release.allizom.org (mrapp-stage04) error

VERIFIED FIXED

Status

mozilla.org Graveyard
Server Operations
--
blocker
VERIFIED FIXED
7 years ago
3 years ago

People

(Reporter: jsocol, Assigned: justdave)

Tracking

Details

(Reporter)

Description

7 years ago
We're getting a stack trace and 500 Internal Server Error from support-release.allizom.org (mrapp-stage04).

The stack trace is below. I don't know what causes this to happen, but either removing .pyc files or, if that doesn't work, the following should fix it:

$ rm -rf vendor
$ git clone --recursive git://github.com/jsocol/kitsune-lib.git vendor

Thanks!


Here's the stack trace:

 Traceback (most recent call last):
  File "/data/www/support-stage-new.mozilla.com/kitsune/wsgi/kitsune.wsgi", line 25, in <module>
    django.utils.translation.activate(django.conf.settings.LANGUAGE_CODE)
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/django/django/utils/translation/__init__.py", line 66, in activate
    return real_activate(language)
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/django/django/utils/functional.py", line 55, in _curried
    return _curried_func(*(args+moreargs), **dict(kwargs, **morekwargs))
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/django/django/utils/translation/__init__.py", line 36, in delayed_loader
    return getattr(trans, real_name)(*args, **kwargs)
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/django/django/utils/translation/trans_real.py", line 193, in activate
    _active[currentThread()] = translation(language)
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/django/django/utils/translation/trans_real.py", line 176, in translation
    default_translation = _fetch(settings.LANGUAGE_CODE)
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/django/django/utils/translation/trans_real.py", line 159, in _fetch
    app = import_module(appname)
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/django/django/utils/importlib.py", line 35, in import_module
    __import__(name)
  File "/data/www/support-stage-new.mozilla.com/kitsune/apps/notifications/__init__.py", line 4, in <module>
    from .models import EventWatch
  File "/data/www/support-stage-new.mozilla.com/kitsune/apps/notifications/models.py", line 8, in <module>
    from sumo.helpers import urlparams
  File "/data/www/support-stage-new.mozilla.com/kitsune/apps/sumo/helpers.py", line 15, in <module>
    from jingo import register, env
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/jingo/jingo/__init__.py", line 140, in <module>
    env = get_env()
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/jingo/jingo/__init__.py", line 42, in get_env
    loaders = [loader(p) for loader, places in x for p in places]
  File "/data/virtualenvs/newkitsune/lib/python2.6/site-packages/jinja2/loaders.py", line 216, in __init__
    provider = get_provider(package_name)
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/packages/setuptools/pkg_resources.py", line 201, in get_provider
    __import__(moduleOrReq)
  File "/data/www/support-stage-new.mozilla.com/kitsune/vendor/src/django-mozilla-product-details/product_details/__init__.py", line 16, in <module>
    from . import settings_defaults
ImportError: cannot import name settings_defaults

Updated

7 years ago
Assignee: server-ops → phong

Comment 1

7 years ago
Cloning into vendor...
remote: Counting objects: 7677, done.
remote: Compressing objects: 100% (5287/5287), done.
remote: Total 7677 (delta 2318), reused 7445 (delta 2108)
Receiving objects: 100% (7677/7677), 26.48 MiB | 6.25 MiB/s, done.
Resolving deltas: 100% (2318/2318), done.
Submodule 'src/bleach' (git://github.com/jsocol/bleach.git) registered for path 'src/bleach'
Submodule 'src/cache-panel' (git://github.com/jbalogh/django-debug-cache-panel) registered for path 'src/cache-panel'
Submodule 'src/check' (git://github.com/jbalogh/check.git) registered for path 'src/check'
Submodule 'src/commonware' (git://github.com/jsocol/commonware.git) registered for path 'src/commonware'
Submodule 'src/django' (git://github.com/django/django) registered for path 'src/django'
Submodule 'src/django-authority' (git://github.com/jsocol/django-authority) registered for path 'src/django-authority'
Submodule 'src/django-cache-machine' (git://github.com/jbalogh/django-cache-machine.git) registered for path 'src/django-cache-machine'
Submodule 'src/django-cronjobs' (git://github.com/jsocol/django-cronjobs.git) registered for path 'src/django-cronjobs'
Submodule 'src/django-csp' (git://github.com/mozilla/django-csp.git) registered for path 'src/django-csp'
Submodule 'src/django-debug-toolbar' (git://github.com/robhudson/django-debug-toolbar.git) registered for path 'src/django-debug-toolbar'
Submodule 'src/django-extensions' (git://github.com/django-extensions/django-extensions.git) registered for path 'src/django-extensions'
Submodule 'src/django-mozilla-product-details' (git://github.com/fwenzel/django-mozilla-product-details) registered for path 'src/django-mozilla-product-details'
Submodule 'src/django-multidb-router' (git://github.com/jbalogh/django-multidb-router.git) registered for path 'src/django-multidb-router'
Submodule 'src/django-nose' (git://github.com/jbalogh/django-nose.git) registered for path 'src/django-nose'
Submodule 'src/django-timezones' (git://github.com/brosner/django-timezones.git) registered for path 'src/django-timezones'
Submodule 'src/jingo' (git://github.com/jbalogh/jingo.git) registered for path 'src/jingo'
Submodule 'src/jingo-minify' (git://github.com/jsocol/jingo-minify.git) registered for path 'src/jingo-minify'
Submodule 'src/py-wikimarkup' (git://github.com/pcraciunoiu/py-wikimarkup.git) registered for path 'src/py-wikimarkup'
Submodule 'src/schematic' (git://github.com/jbalogh/schematic.git) registered for path 'src/schematic'
Submodule 'src/test-utils' (git://github.com/jbalogh/test-utils.git) registered for path 'src/test-utils'
Submodule 'src/tower' (git://github.com/clouserw/tower.git) registered for path 'src/tower'
Submodule 'src/tweepy' (git://github.com/joshthecoder/tweepy.git) registered for path 'src/tweepy'
Cloning into src/bleach...
remote: Counting objects: 375, done.
remote: Compressing objects: 100% (144/144), done.
remote: Total 375 (delta 224), reused 364 (delta 220)
Receiving objects: 100% (375/375), 45.05 KiB, done.
Resolving deltas: 100% (224/224), done.
Submodule path 'src/bleach': checked out 'b85658206b93cc928f32e90bfcc2dfae3711ea95'
Cloning into src/cache-panel...
remote: Counting objects: 6, done.
remote: Compressing objects: 100% (6/6), done.
remote: Total 6 (delta 0), reused 0 (delta 0)
Receiving objects: 100% (6/6), done.
Submodule path 'src/cache-panel': checked out 'dbdffc6048bde9e551f9bc01975ad3373b9c9427'
Cloning into src/check...
remote: Counting objects: 32, done.
remote: Compressing objects: 100% (32/32), done.
remote: Total 32 (delta 12), reused 0 (delta 0)
Receiving objects: 100% (32/32), 26.68 KiB, done.
Resolving deltas: 100% (12/12), done.
Submodule path 'src/check': checked out '1c73813fcd085020decc6f72caf232f71150db0a'
Cloning into src/commonware...
remote: Counting objects: 138, done.
remote: Compressing objects: 100% (93/93), done.
remote: Total 138 (delta 64), reused 83 (delta 39)
Receiving objects: 100% (138/138), 17.14 KiB, done.
Resolving deltas: 100% (64/64), done.
Submodule path 'src/commonware': checked out '3289ea4593a15ae7a879ecea8701b0f33dba171f'
Cloning into src/django...
remote: Counting objects: 100371, done.
remote: Compressing objects: 100% (26641/26641), done.
remote: Total 100371 (delta 78295), reused 93078 (delta 71980)
Receiving objects: 100% (100371/100371), 25.28 MiB | 1.90 MiB/s, done.
Resolving deltas: 100% (78295/78295), done.
Submodule path 'src/django': checked out '68692eef88464887f2343e77256352384999a171'
Cloning into src/django-authority...
remote: Counting objects: 96, done.
remote: Compressing objects: 100% (89/89), done.
remote: Total 96 (delta 1), reused 0 (delta 0)
Receiving objects: 100% (96/96), 151.06 KiB, done.
Resolving deltas: 100% (1/1), done.
Submodule path 'src/django-authority': checked out '543c39a889444488de2b16be72da61b1845b9141'
Cloning into src/django-cache-machine...
remote: Counting objects: 315, done.
remote: Compressing objects: 100% (114/114), done.
remote: Total 315 (delta 191), reused 313 (delta 191)
Receiving objects: 100% (315/315), 45.03 KiB, done.
Resolving deltas: 100% (191/191), done.
Submodule path 'src/django-cache-machine': checked out 'd03fa491d8e651abb8f8eb71f4a24fd3b2b2252c'
Cloning into src/django-cronjobs...
remote: Counting objects: 19, done.
remote: Compressing objects: 100% (17/17), done.
remote: Total 19 (delta 2), reused 0 (delta 0)
Receiving objects: 100% (19/19), done.
Resolving deltas: 100% (2/2), done.
Submodule path 'src/django-cronjobs': checked out 'fa411be81d26619c973ec281c5cce2ce5219bd9c'
Cloning into src/django-csp...
remote: Counting objects: 84, done.
remote: Compressing objects: 100% (41/41), done.
remote: Total 84 (delta 31), reused 84 (delta 31)
Receiving objects: 100% (84/84), 11.07 KiB, done.
Resolving deltas: 100% (31/31), done.
Submodule path 'src/django-csp': checked out '5c5f5a6b55fb78e99db939c79f0f0d8003a62c98'
Cloning into src/django-debug-toolbar...
remote: Counting objects: 3028, done.
remote: Compressing objects: 100% (1069/1069), done.
remote: Total 3028 (delta 1804), reused 2811 (delta 1644)
Receiving objects: 100% (3028/3028), 544.73 KiB | 748 KiB/s, done.
Resolving deltas: 100% (1804/1804), done.
Submodule path 'src/django-debug-toolbar': checked out 'ee1811238e91ae0ad33413b0d40d2f8482101951'
Cloning into src/django-extensions...
remote: Counting objects: 2234, done.
remote: Compressing objects: 100% (870/870), done.
remote: Total 2234 (delta 1355), reused 2067 (delta 1240)
Receiving objects: 100% (2234/2234), 373.62 KiB | 664 KiB/s, done.
Resolving deltas: 100% (1355/1355), done.
Submodule path 'src/django-extensions': checked out '1610e1e59124071e1d01b3814b6f17ff72b526bb'
Cloning into src/django-mozilla-product-details...
remote: Counting objects: 122, done.
remote: Compressing objects: 100% (57/57), done.
remote: Total 122 (delta 60), reused 120 (delta 60)
Receiving objects: 100% (122/122), 19.45 KiB, done.
Resolving deltas: 100% (60/60), done.
Submodule path 'src/django-mozilla-product-details': checked out '659f19166aab50b5f58289b3445bae7406b4100d'
Cloning into src/django-multidb-router...
remote: Counting objects: 45, done.
remote: Compressing objects: 100% (29/29), done.
remote: Total 45 (delta 14), reused 37 (delta 11)
Receiving objects: 100% (45/45), 12.13 KiB, done.
Resolving deltas: 100% (14/14), done.
Submodule path 'src/django-multidb-router': checked out '25ca0c68929144ed9020d89f2ea1e941c7f9aeca'
Cloning into src/django-nose...
remote: Counting objects: 272, done.
remote: Compressing objects: 100% (143/143), done.
remote: Total 272 (delta 144), reused 247 (delta 125)
Receiving objects: 100% (272/272), 33.95 KiB, done.
Resolving deltas: 100% (144/144), done.
Submodule path 'src/django-nose': checked out 'afa6060d56a2480a3bb19d67e70e0967dcb656eb'
Cloning into src/django-timezones...
remote: Counting objects: 277, done.
remote: Compressing objects: 100% (151/151), done.
remote: Total 277 (delta 146), reused 233 (delta 112)
Receiving objects: 100% (277/277), 35.73 KiB, done.
Resolving deltas: 100% (146/146), done.
Submodule path 'src/django-timezones': checked out '2b903a38da1ff9df4b2aba8e4f5429d967f73881'
Cloning into src/jingo...
remote: Counting objects: 125, done.
remote: Compressing objects: 100% (64/64), done.
remote: Total 125 (delta 53), reused 123 (delta 53)
Receiving objects: 100% (125/125), 19.38 KiB, done.
Resolving deltas: 100% (53/53), done.
Submodule path 'src/jingo': checked out '9c8fdfc63765db0e8b176444d9160499f58ebcea'
Cloning into src/jingo-minify...
remote: Counting objects: 63, done.
remote: Compressing objects: 100% (34/34), done.
remote: Total 63 (delta 25), reused 62 (delta 24)
Receiving objects: 100% (63/63), 799.97 KiB | 470 KiB/s, done.
Resolving deltas: 100% (25/25), done.
Submodule path 'src/jingo-minify': checked out '95f24e9ecdbeb5d1d88029896b3d53ae8828e533'
Cloning into src/py-wikimarkup...
remote: Counting objects: 132, done.
remote: Compressing objects: 100% (63/63), done.
remote: Total 132 (delta 61), reused 132 (delta 61)
Receiving objects: 100% (132/132), 75.65 KiB, done.
Resolving deltas: 100% (61/61), done.
Submodule path 'src/py-wikimarkup': checked out '418936741d9bba1e6326716428a25e7223e58709'
Cloning into src/schematic...
remote: Counting objects: 71, done.
remote: Compressing objects: 100% (37/37), done.
remote: Total 71 (delta 34), reused 67 (delta 32)
Receiving objects: 100% (71/71), 12.31 KiB, done.
Resolving deltas: 100% (34/34), done.
Submodule path 'src/schematic': checked out 'e749978cc06bda8ba655faf8d672ae270e25b5f5'
Cloning into src/test-utils...
remote: Counting objects: 72, done.
remote: Compressing objects: 100% (40/40), done.
remote: Total 72 (delta 27), reused 71 (delta 27)
Receiving objects: 100% (72/72), 13.43 KiB, done.
Resolving deltas: 100% (27/27), done.
Submodule path 'src/test-utils': checked out 'ce0e9643ea3b38373823e04d8c2e5f2dc2de5665'
Cloning into src/tower...
remote: Counting objects: 201, done.
remote: Compressing objects: 100% (88/88), done.
remote: Total 201 (delta 105), reused 192 (delta 101)
Receiving objects: 100% (201/201), 31.43 KiB, done.
Resolving deltas: 100% (105/105), done.
Submodule path 'src/tower': checked out 'c074ca52258e1b882bf2aeac8da53eeebb7b3416'
Cloning into src/tweepy...
remote: Counting objects: 1828, done.
remote: Compressing objects: 100% (671/671), done.
remote: Total 1828 (delta 1274), reused 1668 (delta 1147)
Receiving objects: 100% (1828/1828), 372.88 KiB, done.
Resolving deltas: 100% (1274/1274), done.
Submodule path 'src/tweepy': checked out '179debf197d443c85d73d6e837aa990f9ff6acd2'
Status: NEW → RESOLVED
Last Resolved: 7 years ago
Resolution: --- → FIXED
(Reporter)

Comment 2

7 years ago
We're still getting the same stack trace and support-release.allizom.org still doesn't work.

For diagnosis, it might be interesting to go into the shell (manage.py shell) and try to "import product_details" or "from product_details import settings_defaults". I expect that to work, so it will be interesting if it doesn't.

I had this issue locally this morning and solved it by:

cd vendor
rm -rf src/django-mozilla-product-details
git submodule update --init
cd ..
python manage.py update_product_details
cd vendor/src/django-mozilla-product-details/product_details/json
chmod -R a+r .
service httpd restart

Unfortunately no one has any idea why this import fails from Django/Apache sometimes.
Assignee: phong → server-ops
Severity: critical → blocker
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
steps from comment 2 done.  the import didn't get any errors, so no additional debug info out of it. :|
Assignee: server-ops → justdave
Status: REOPENED → RESOLVED
Last Resolved: 7 years ago7 years ago
Resolution: --- → FIXED
(Reporter)

Comment 4

7 years ago
Thanks, Dave. Working for me.

The import never has any errors. It's been an incredible pain to debug.
Status: RESOLVED → VERIFIED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.