Closed Bug 1353671 Opened 7 years ago Closed 7 years ago

Lots of task in nightlys fail with pkg_resources.DistributionNotFound: arrow

Categories

(Release Engineering :: Release Automation: Other, defect)

Product:
Release Engineering
Component:
Release Automation: Other
Type:
defect
Priority:
Not set
Severity:
critical

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: cbook, Assigned: mtabara)

References

(
URL
)

Details

(Whiteboard: [stockwell infra]) 

https://treeherder.mozilla.org/logviewer.html#?job_id=88794208&repo=mozilla-aurora&lineNumber=1-11

Traceback (most recent call last):
  File "/builds/scriptworker/py27venv/bin/balrogscript", line 5, in <module>
    from pkg_resources import load_entry_point
  File "/builds/scriptworker/py27venv/lib/python2.7/site-packages/distribute-0.6.24-py2.7.egg/pkg_resources.py", line 2707, in <module>
    working_set.require(__requires__)
  File "/builds/scriptworker/py27venv/lib/python2.7/site-packages/distribute-0.6.24-py2.7.egg/pkg_resources.py", line 686, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/builds/scriptworker/py27venv/lib/python2.7/site-packages/distribute-0.6.24-py2.7.egg/pkg_resources.py", line 584, in resolve
    raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: arrow
exit code: 1
Most likely fallback from this change[0] which landed in tools the other day. I'm surprised this breaks as I took care of the balrogscript side. Maybe I should've added the package dependency in puppet[1] as well ?

Will debugg now.

[0]: https://hg.mozilla.org/build/tools/rev/68fd4127c104#l2.4
[1]: https://hg.mozilla.org/build/puppet/file/tip/modules/balrog_scriptworker/manifests/init.pp#l56
Assignee: nobody → mtabara
Status: NEW → ASSIGNED
In bug 1341352 I added https://github.com/mozilla-releng/balrogscript/blob/master/setup.py#L30 in balrogscript setup.py itself but obviously that's not enough since puppet won't recreate virtual environments based on that, but it's own manifest. I was supposed to munge that too altogether.

Pushed a fix in https://hg.mozilla.org/build/puppet/rev/31dab5f28867.
Waiting for tests to pass following which will deploy that on both balrogworkers instances.
Component: Buildduty → Release Automation
QA Contact: bugspam.Callek → rail
See Also: → 1341352
Both balrogworkers updated to encompass that arrow missing dep in puppet:
https://hg.mozilla.org/build/puppet/rev/31dab5f28867
Add missing python-dateutil dep for balrogscript. r=bustage
https://hg.mozilla.org/build/puppet/rev/4c2ce28e4236
(In reply to Mihai Tabara [:mtabara]⌚️GMT+8 from comment #4)
> Add missing python-dateutil dep for balrogscript. r=bustage
> https://hg.mozilla.org/build/puppet/rev/4c2ce28e4236

Both balrogworkers updated to encompass that python-dateutil missing dep in puppet.
Retriggered a mozilla-central "balrog-beetmover-es-MX-signing-l10n-linux64-nightly-6/opt" which went green. Hopefully the others will follow.

Sample: https://tools.taskcluster.net/task-inspector/#Il4Qrm_5TK6LipnFCSCOjA/

Closing this now, please reopen should any other issues come up.
Status: ASSIGNED → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Whiteboard: [stockwell infra]
You need to log in before you can comment on or make changes to this bug.