760111 - Disconnect Error in endurance test: testFlash_SWFVideoEmbed

Status: RESOLVED FIXED

(Mozilla QA Graveyard :: Mozmill Tests, defect)

Description

[Dave Hunt [:davehunt] [he/him] ⌚BST]

The /testFlash_SWFVideoEmbed/test1.js test is failing regularly on Linux Ubuntu 32bit. See recent test failures:

http://mozmill-ci.blargon7.com/#/endurance/report/fdec829b93b19c73985be1d388361f7a
http://mozmill-ci.blargon7.com/#/endurance/report/fdec829b93b19c73985be1d38834c106

It doesn't fail every time though, and when it passes it's not with high memory usage. See a recent pass:

http://mozmill-ci.blargon7.com/#/endurance/report/fdec829b93b19c73985be1d388350ee1

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I will attempt to replicate this on qa-masterblaster whilst watching the testrun.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This happened a lot lately. Can we please get this backed-out ASAP and investigated afterward?

http://mozmill-ci.blargon7.com/#/endurance/report/23e194f1171aa4baf774928b262b657c

Vlad, mind taking it?

Comment 3

[Maniac Vlad Florin (:vladmaniac)]

(In reply to Henrik Skupin (:whimboo) from comment #2)
> This happened a lot lately. Can we please get this backed-out ASAP and
> investigated afterward?
> 
> http://mozmill-ci.blargon7.com/#/endurance/report/
> 23e194f1171aa4baf774928b262b657c
> 
> Vlad, mind taking it?

Do we need to back out or just skip the test?

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Well, I meant skip. Sorry.

Comment 5

[Maniac Vlad Florin (:vladmaniac)]

Attachment: skip the test

skip the test until further investigation results

Comment 6

[Maniac Vlad Florin (:vladmaniac)]

So the test alone does not fail 

http://mozmill-crowd.blargon7.com/#/endurance/report/23e194f1171aa4baf774928b262fead9

The investigation plan is to run the test alone see if this triggers the disconnect, then run the whole testrun several times and if the error is echoed, then we might draw the conclusion that our test failure is run order dependent.

Comment 7

[Maniac Vlad Florin (:vladmaniac)]

Running the whole testrun does not trigger the error 

http://mozmill-crowd.blargon7.com/#/endurance/report/23e194f1171aa4baf774928b26324d6e 

Moving fwd with loading the system by building b2g locally, that is cloning the github repo and doing some make commands and load the processor to more than 70%

Comment 8

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Comment on attachment 638304 [details] [diff] [review]
skip the test

So I have checked this again and it's only failing on our suspicious Windows Vista VM which also has shown a couple of other failures lately. For now I will replace this VM with a fresh copy. Lets see if that helps.

Comment 10

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Looks like we are ok now. Vlad where there any testrun with such a broken test? I don't think so. Lets wait one or two more days and then lets close as fixed.

Comment 11

[Maniac Vlad Florin (:vladmaniac)]

(In reply to Henrik Skupin (:whimboo) from comment #10)
> Looks like we are ok now. Vlad where there any testrun with such a broken
> test? I don't think so. Lets wait one or two more days and then lets close
> as fixed.

I was indeed monitoring all endurance testrun since I am focused on that area at the moment. This was not a failure recently

Comment 12

[Henrik Skupin [:whimboo][⌚️UTC+2]]

On Windows this most likely depends on bug 770821. Not sure about the other platforms we got failures too.

Comment 13

[Maniac Vlad Florin (:vladmaniac)]

The disconnect did not appear in the past 7 days at all 
http://mozmill-ci.blargon7.com/#/endurance/reports?branch=16.0&platform=All&from=2012-07-03&to=2012-07-10

Comment 14

[Henrik Skupin [:whimboo][⌚️UTC+2]]

I forgot to install Flash on that machine. See the skipped tests:

http://mozmill-ci.blargon7.com/#/endurance/report/99ab6c49d005522227c5717d8a0ffb4e

I will do this now.

Comment 15

[Maniac Vlad Florin (:vladmaniac)]

thanks Henrik

Comment 16

[Maniac Vlad Florin (:vladmaniac)]

Does this failure still occur? 
I don't see it on mozmill-ci anymore

Comment 17

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Please see bug 770821 comment 21.

Comment 18

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Fixed with Mozmill 1.5.15:

http://mozmill-crowd.blargon7.com/#/endurance/report/89726f6b98208a209e7ce2df1027ee7b