632305 - Move build-recommendations.py to zamboni and make sure it doesn't take 6 hours

Status: RESOLVED FIXED

(addons.mozilla.org Graveyard :: Code Quality, defect, P3)

Description

[Wil Clouser [:clouserw]]

[amo-developers] Cron <apache@mradm02> cd	/data/amo/www/addons.mozilla.org-remora/bin;	/usr/bin/python26 build-recommendations.py addons

Traceback (most recent call last):
  File "build-recommendations.py", line 203, in <module>
    main()
  File "build-recommendations.py", line 199, in main
    return cmd()
  File "build-recommendations.py", line 77, in __call__
    self.insert(self.correlate())
  File "build-recommendations.py", line 110, in insert
    cursor.execute(self.q['insert'] + records)
  File "/usr/lib64/python2.6/site-packages/MySQLdb/cursors.py", line 173, in execute
    self.errorhandler(self, exc, value)
  File "/usr/lib64/python2.6/site-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
    raise errorclass, errorvalue
_mysql_exceptions.IntegrityError: (1452, 'Cannot add or update a child row: a foreign key constraint fails (`addons_remora/addon_recommendations`, CONSTRAINT `addon_recommendations_ibfk_1` FOREIGN KEY (`addon_id`) REFERENCES `addons` (`id`))')

Comment 1

[Jeff Balogh (:jbalogh)]

<oremj> apache   30859 81.6  3.6 398792 294972 ?       R    10:30 312:42 /usr/bin/python26 build-recommendations.py addons

Comment 3

[Jeff Balogh (:jbalogh)]

git revert ae9f0de

Comment 4

[Jeff Balogh (:jbalogh)]

https://github.com/jbalogh/zamboni/commit/2bcfa94

All the code is in but I'm not turning on the cron job until bug 634482 is done.

Comment 5

[Jeff Balogh (:jbalogh)]

Flipped the cron in https://github.com/jbalogh/zamboni/commit/19cddf7.