647358 - [kitsune] Run tests on kitsune-stage after every automatic update

Status: RESOLVED WONTFIX

(support.mozillamessaging.com Graveyard :: General, defect)

Description

[Roland Tanglao needinfo please :rolandtanglao, :mohnkuchen, :adobo, :sinigang, :roland]

as per the summary and please email the results to 
:rolandtanglao
AND
:sancus

Comment 1

[James Socol [:jsocol, :james]]

The tests tend to fail if they're running in an environment with a working, running celeryd daemon--I'm not entirely sure why, the tests should ignore it, but it hasn't been terribly high priority to investigate.

I'd be happy to help get you guys set up on hudson/jenkins/CI to run the test suite, though.

Comment 2

[Philippe M. Chiasson (:gozer)]

Attachment: [output] ./manage.py test

When attempting to run the test suite in stage, from a fresh database (i.e. no previous data), I get a consistent setup failure each time, before even a single test gets to run:

django.db.utils.IntegrityError: (1062, "Duplicate entry 'admin-logentry' for key 'app_label'")

Comment 3

[James Socol [:jsocol, :james]]

You really don't want to run the tests _on_ a staging server. Ping me and I'll help you get a job set up on Jenkins.

Comment 4

[Philippe M. Chiasson (:gozer)]

(In reply to comment #3)
> You really don't want to run the tests _on_ a staging server.

Why not? It would serve as a sort of acceptance test prior to moving into production.

But, I am still confused as to why the test fails in the way it fails.

Comment 5

[Philippe M. Chiasson (:gozer)]

(In reply to comment #3)
> Ping me and
> I'll help you get a job set up on Jenkins.

Sounds like a good idea as well, expect to be ping'ed tomorrow.

Comment 6

[James Socol [:jsocol, :james]]

(In reply to comment #4)
> (In reply to comment #3)
> > You really don't want to run the tests _on_ a staging server.
> 
> Why not? It would serve as a sort of acceptance test prior to moving into
> production.

The tests create and remove files on the local file system, they were not designed to run in parallel with actual configuration. They fail in the presence of a running celeryd instance--though I'm not sure why--they can, if you're not careful, clobber your existing search indices. They delete all the images they know about in the test DB, which they also need to create and drop.

You can run them on a staging server but it's "omg not supported"/at your own risk/we make no guarantee they won't destroy data on the staging server.

Comment 7

[Philippe M. Chiasson (:gozer)]

In that case, certainly won't do this on stage.