739106 - Validation runs forever

Status: RESOLVED FIXED

(addons.mozilla.org Graveyard :: Add-on Validation, defect)

Description

[Giorgio Maone [:ma1]]

I've tried several times to upload https://secure.informaction.com/download/betas/noscript-2.3.6rc3.xpi

At this moment I've got 3 tabs open on the progress bar saying "Validating noscript-2.3.6rc3.xpi", the most recent dating back at least 10 minutes ago.

Comment 1

[Kumar McMillan [:kumar]]

Sorry about the inconvenience. We appear to have unusually high load on our validation cluster. Thanks for the bug report. Hopefully it will be resolved soon (I filed bug 739111).

Comment 4

[Wraithan (Chris McDonald) [:wraithan]]

It was mentioned in the other ticket that celery got bounced. I'd like to note that this is problem for me still.

Comment 5

[Giorgio Maone [:ma1]]

It's working now for me, thank you.

Comment 6

[Michael Kraft [:morac]]

I just ran into this problem trying to update my Tab Counter addon.  That add-on is less than 38 KB in size so if that's hanging then I think any add-on would.  I'm reopening since I can't complete the upload.

Comment 7

[Michael Kraft [:morac]]

What's odd is that I can validate older (already uploaded) versions of my add-on, but it won't finish validating a newly updated one.  I've been trying for the past 30 minutes.

Comment 8

[Kumar McMillan [:kumar]]

(In reply to Michael Kraft [:morac] from comment #7)
> What's odd is that I can validate older (already uploaded) versions of my
> add-on, but it won't finish validating a newly updated one.  I've been
> trying for the past 30 minutes.

Can you attach the newly updated xpi that you are having trouble with?

Comment 9

[Michael Kraft [:morac]]

Attachment: New version of tab counter add-on, never finishes validating

This is a new version of my tab counter add-on, which only contains very minor changes from version 1.9.2.  It never completes validation.

Comment 10

[Michael Kraft [:morac]]

I just want to clarify that when I say I can validate existing versions, I'm talking about the link on the versions page that says "validate now".  That works fine.  If I try to validate by uploading the same exact older version at the https://addons.mozilla.org/en-US/developers/addon/validate page, it hangs.  So it will validate AMO hosted files, but not uploaded ones.

Comment 11

[Siddhartha Dugar [:sdrocking]]

I also cannot upload a new version of my addon. Even changing the displayed icon for an addon goes to "Image changes being processed" and stays there forever.

Comment 12

[Jan Wedding]

I also tried to upload a new version and validation just did not finish, so I was not able to add the new version.

Comment 13

[Michael Kraft [:morac]]

I was just able to do an upload of my updated add-on and it validated immediately.  Looks like the problem is either intermittent or the server requires frequent restarting.

Comment 14

[Michael Kraft [:morac]]

I was just able to do an upload of my updated add-on and it validated immediately.  Looks like the problem is either intermittent or the server requires frequent restarting.

Comment 15

[Michael Kraft [:morac]]

Oops sorry for the double post.

Comment 16

[Kumar McMillan [:kumar]]

We are running into a celery bug in production due to an old version we are running. We upgraded (bug 739702) and that change will go out on Thursday. Until then, the queue might be unstable intermittently.

Comment 17

[Wil Clouser [:clouserw]]

That patch went out and I just tested the attached .xpi.  It validated instantly with no errors and 1 warning.  Closing.

Comment 18

[Stefano Verna]

This problem is still around. I'm trying to upload an XPI (http://tinyurl.com/cse22mq) but I'm stuck with a 100% completed upload, and a never-ending validation process.

The page keeps on hitting the URL "https://addons.mozilla.org/en-US/developers/upload/fba437f62d604b42b3ea813fdd8e2602/json".

If I try to visit "https://addons.mozilla.org/en-US/developers/upload/fba437f62d604b42b3ea813fdd8e2602" (that is, the "Validation Results" page), I'm getting this error:

"Error: Validation task could not complete or completed with errors" (screenshot: http://o7.no/jhZNGx)

I also tried the same process in the staging server (addons-dev.allizom.org), and it works there (giving me 2 warnings as result).

Comment 19

[Siddhartha Dugar [:sdrocking]]

This problem still exists :(

Comment 20

[Onno Ekker [:nONoNonO UTC+1]]

I can't upload a new version at the moment either. Stuck at uploading 100% and the popup says Validating...

Comment 21

[Giorgio Maone [:ma1]]

Reopening per comments 18-20.

Comment 22

[Wil Clouser [:clouserw]]

Attachment: zazit works

I downloaded the .xpi in comment 18 and tested it on https://addons.mozilla.org/en-US/developers/addon/validate

It worked fine for me.  Can you try your failing add-ons on that URL?

Comment 23

[Siddhartha Dugar [:sdrocking]]

It happens intermittently, I succeeded after spending almost an hour.

Comment 24

[Onno Ekker [:nONoNonO UTC+1]]

Yep, it happens intermittently. Just now I had no problems uploading my extension twice... A couple of hours ago I tried it several times in a row to no avail.

Comment 25

[Dennis Baldwin]

I'm seeing this problem right now as I try to upload the latest version of our add-on. Not sure if it's worth noting, but we are making use of the add-on SDK (v 1.6.1 at this time). I've tried to upload about 5 times already and it continues to hang on "Validating..."

Comment 26

[Kumar McMillan [:kumar]]

Can you upload the addon that caused this? It's triggering a traceback in our validator and that is stressing our validation cluster.

Comment 27

[Matt Basta [:basta]]

Can anyone confirm that this issue still exists?

Comment 28

[Kumar McMillan [:kumar]]

We had a lot of stability issues with celery and validation at the time of these bug comments but jason and oremj were able to resolve those issues. We also have not seeing such drastic queue problems since upgrading celery (which fixed bugs in the event loop). Based on the recent stability I'll close this bug. If there are new intermittent upload errors, please file a new bug.