923875 - Monolith cron not running on -dev

Status: RESOLVED FIXED

(Cloud Services :: Operations: Marketplace, task)

Description

[Rob Hudson [:robhudson]]

Latest error from the cron email:

Traceback (most recent call last): 
File "../venv/bin/monolith-extract", line 8, in <module> 
from pkg_resources import load_entry_point 
File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/venv/lib/python2.6/site-packages/distribute-0.6.34-py2.6.egg/pkg_resources.py", line 2803, in <module> 
working_set.require(__requires__) 
File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/venv/lib/python2.6/site-packages/distribute-0.6.34-py2.6.egg/pkg_resources.py", line 696, in require 
needed = self.resolve(parse_requirements(requirements)) 
File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/venv/lib/python2.6/site-packages/distribute-0.6.34-py2.6.egg/pkg_resources.py", line 594, in resolve 
raise DistributionNotFound(req) 
pkg_resources.DistributionNotFound: six

Comment 1

[Jason Thomas [:jason]]

I added six to requirements/prod.txt. I am now receiving the following error, could you please assist?

[[e-mail]1 monolith-aggregator]# ../venv/bin/monolith-extract --date yesterday configs/monolith.ini
Traceback (most recent call last):
  File "../venv/bin/monolith-extract", line 12, in <module>
    load_entry_point('monolith.aggregator==0.4', 'console_scripts', 'monolith-extract')()
  File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/extract.py", line 105, in main
    args.force, args.purge_only)
  File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/extract.py", line 35, in extract
    sequence = Sequence(parser, sequence)
  File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/sequence.py", line 33, in __init__
    self._sequence = [self._build_phase(phase) for phase in sequence]
  File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/sequence.py", line 52, in _build_phase
    for source in options['sources'].split(',')]
  File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/sequence.py", line 42, in _load
    return self._load_plugin(type_, name, self.config[type_][name])
  File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/sequence.py", line 64, in _load_plugin
    plugin = resolve_name(options['use'])
  File "/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/resolver.py", line 118, in resolve_name
    __import__(modname)
monolith.aggregator.resolver.ImportStringError: import_string() failed for 'monolith.aggregator.plugins.ganalytics.GoogleAnalytics'. Possible reasons are:

- missing __init__.py in a package;
- package or module path not included in sys.path;
- duplicated package or module name taking precedence in sys.path;
- missing module, class, function or variable;

Debugged import:

- 'monolith' found in '/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/__init__.pyc'.
- 'monolith.aggregator' found in '/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/__init__.pyc'.
- 'monolith.aggregator.plugins' found in '/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/plugins/__init__.py'.
- 'monolith.aggregator.plugins.ganalytics' found in '/data/addons-dev/src/monolith-aggregator-dev.allizom.org/monolith-aggregator/monolith/aggregator/plugins/ganalytics.py'.
- 'monolith.aggregator.plugins.ganalytics.GoogleAnalytics' not found.

Original exception:

ImportError: No module named GoogleAnalytics

Comment 2

[Jason Thomas [:jason]]

Updated aggregator config on -dev and stage to use monolith.aggregator.plugins.ganalytics.BaseGoogleAnalytics. I will merge in https://github.com/mozilla-services/svcops-puppet/commit/29417196be3797d66e7d110eef15b9bb77afc136 before a prod code push.