Closed Bug 720377 Opened 13 years ago Closed 13 years ago

Test on test slaves the builds from http://people.mozilla.org/~respindola/builds/

Categories

(Release Engineering :: General, defect)

Product:
Release Engineering
Component:
General
Platform:
x86
macOS
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: armenzg, Assigned: armenzg)

References

Details

(Whiteboard: summary on comment 10 - we have to fix 1 perma-oranges)

Attachments

(2 files)

reduced test of the bug the 10.6 run found
966 bytes, text/plain
Details
data file for the testcase
196 bytes, image/png
Details
These are builds on a 10.7 machine with the 10.6 sdk and xcode 4.1 (gcc-4.2). Let's see how our test slaves deal with those builds.
This is relevant to bug 720027
Blocks: 720027
Assignee: nobody → armenzg
(In reply to Armen Zambrano G. [:armenzg] - Release Engineer from comment #2) > espindola, I have found many Lion oranges. Would you be able to look at them > and see what you can figure out? We normally have Lion oranges when building on 10.6. Are these new oranges. I.e., do they show up only when building on 10.7? > I'm retriggering them again to see if they repeat. Thanks. > There is also this specific 10.6 failure: > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327370120. > 1327371268.9702.gz&fulltext=1 looking. > I failed to trigger the debug tests so we might have more failures there. > > 10.5 came about clean. thanks.
(In reply to Rafael Ávila de Espíndola (:espindola) from comment #3) > (In reply to Armen Zambrano G. [:armenzg] - Release Engineer from comment #2) > > espindola, I have found many Lion oranges. Would you be able to look at them > > and see what you can figure out? > > We normally have Lion oranges when building on 10.6. Are these new oranges. > I.e., do they show up only when building on 10.7? > Oh noes! https://tbpl.mozilla.org/?jobname=Lion&noignore=1 It seems that no one has been trying to make those tests green. jhford, do you have a bug to track all Lion oranges? We don't really have to fix all of those oranges if they're already orange. Not that we should abandon them but that as long as we don't regress any of the ones going orange then we're OK to proceed with the switch over. The current list of green lion suites are: * opt: m3, m4, c, J, R * debug: J It seems that we *do* regress these green Lion suites: > * crashtest: > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327366009. > 1327366381.31912.gz&fulltext=1 > * mochitest-3/5: > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327362803. > 1327363627.25353.gz&fulltext=1 > * reftest: > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327373951. > 1327375152.16458.gz&fulltext=1 Makes sense?
I will try to take a look at those too. The 10.6 regression is interesting. I was able to reproduce it on 10.6 and now directly out of the build directory on 10.7. I am debugging it and will update this bug or open a dependency once I find out more.
We never do 32 bit test runs on 10.6, and doing so found a bug on the OS. Attached is a reduced testcase.
These are the new results after: 1) actually triggering 10.5 *debug* tests 2) Testing 64-bit debug build on 10.6 and 10.7 rather than the 32-bit debug build The summary is that we have the following *new* regressions: * 1 10.5 debug regression * 1 10.6 opt regression * 3 10.7 opt regression ##### DEBUG RESULTS (NEW) ###### [NEW] Rev3 MacOSX Leopard 10.5.8 mozilla-central debug test mochitests-1/5 tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327526901.1327527870.23979.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test crashtest http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327528294.1327528737.25446.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test mochitest-other http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327531758.1327534869.6564.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test mochitests-1/5 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327520918.1327522265.9763.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test mochitests-2/5 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327526341.1327527022.21786.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test mochitests-3/5 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327527128.1327528194.24421.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test mochitests-5/5 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327524110.1327524628.16382.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test reftest http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327522364.1327524000.14305.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test xpcshell http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327528841.1327531188.30489.gz ##### OPT RESULTS ###### [NEW] Rev4 MacOSX Snow Leopard 10.6 mozilla-central opt test reftest http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327370120.1327371268.9702.gz&fulltext=1 [NEW] Rev4 MacOSX Lion 10.7 mozilla-central opt test crashtest http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327366009.1327366381.31912.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central opt test mochitest-other http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327375254.1327377969.21935.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central opt test mochitests-1/5 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327361567.1327362703.22854.gz&fulltext=1 [NEW] Rev4 MacOSX Lion 10.7 mozilla-central opt test mochitests-3/5 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327362803.1327363627.25353.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central opt test mochitests-5/5 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327359937.1327360334.17931.gz [NEW] Rev4 MacOSX Lion 10.7 mozilla-central opt test reftest http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327373951.1327375152.16458.gz&fulltext=1 [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central opt test xpcshell http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327363728.1327365890.30301.gz&fulltext=1
Whiteboard: summary on comment 5 - we have to fix 4 perma-oranges
Let's do this again. It seems that the opt jobs were downloading the debug builds (*sigh*). The summary is that we have the following *new* regressions: * 1 10.5 debug regression espindola, can you please look at the 10.5 regressions? ##### OPT RESULTS ##### No regressions. Same as comment 9: > ##### DEBUG RESULTS (NEW) ###### > [NEW] Rev3 MacOSX Leopard 10.5.8 mozilla-central debug test mochitests-1/5 > https://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327526901.1327527870. > 23979.gz&fulltext=1 > > [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test crashtest > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327528294. > 1327528737.25446.gz&fulltext=1 > > [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test > mochitest-other > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327531758. > 1327534869.6564.gz&fulltext=1 > > [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test > mochitests-1/5 > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327520918. > 1327522265.9763.gz&fulltext=1 > > [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test > mochitests-2/5 > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327526341. > 1327527022.21786.gz&fulltext=1 > > [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test > mochitests-3/5 > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327527128. > 1327528194.24421.gz&fulltext=1 > > [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test > mochitests-5/5 > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327524110. > 1327524628.16382.gz&fulltext=1 > > [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test reftest > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327522364. > 1327524000.14305.gz&fulltext=1 > > [ALREADY ORANGE] Rev4 MacOSX Lion 10.7 mozilla-central debug test xpcshell > http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327528841. > 1327531188.30489.gz
So the only regression left for me to look at is https://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327526901.1327527870.23979.gz&fulltext=1 right? Loading that link is timing out :-( Can you put the log on people.mozilla.org?
(In reply to Rafael Ávila de Espíndola (:espindola) from comment #11) > So the only regression left for me to look at is > > https://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327526901. > 1327527870.23979.gz&fulltext=1 > > right? Loading that link is timing out :-( Can you put the log on > people.mozilla.org? Due to bug 722821, where https://tinderbox.m.o incorrect points to an MXR instance, please change from https to http. The log loads up perfectly for me once I change the protocol.
Sorry about that. I got distracted with the release. Here is the log: http://people.mozilla.com/~armenzg/archive/bug720377.log
Once you file a bug, could you please make it block bug 720027? I think we can close this bug for now.
Whiteboard: summary on comment 5 - we have to fix 4 perma-oranges → summary on comment 10 - we have to fix 1 perma-oranges
Depends on: 725126
We finished the work in here IIUC. I filed bug 725126 for the perma-orange and blocked bug 720027 to keep track of it once we have the 10.7 builders.
Status: NEW → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
espindola, you asked me to test new builds? Should I use the same url? http://people.mozilla.org/~respindola/builds/ ?
I mean, I see new builds: http://people.mozilla.org/~respindola/builds/new/ Is that it?
(In reply to Armen Zambrano G. [:armenzg] - Release Engineer from comment #10) > Same as comment 9: > > ##### DEBUG RESULTS (NEW) ###### > > [NEW] Rev3 MacOSX Leopard 10.5.8 mozilla-central debug test mochitests-1/5 > > https://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1327526901.1327527870. > > 23979.gz&fulltext=1 10.5 came out completely green. Here is the build that was used: new/macosx32-debug/firefox-13.0a1.en-US.mac.dmg 10.6 also came clean. 10.7 not so much. I will trigger one more run and see if it gets any better. http://tinderbox.mozilla.org/showbuilds.cgi?tree=MozillaTest&maxdate=1330505026&legend=0&norules=1 Pretty much every suite came out orange. http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330477229.1330477678.15712.gz&fulltext=1 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330480306.1330481755.23806.gz&fulltext=1 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330478899.1330479572.18692.gz&fulltext=1 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330470371.1330473680.8277.gz&fulltext=1 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330477782.1330478794.17489.gz&fulltext=1 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330479683.1330480192.20332.gz&fulltext=1 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330475315.1330477128.14198.gz&fulltext=1 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330474555.1330474868.10461.gz&fulltext=1 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330474971.1330475209.10922.gz&fulltext=1 http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1330473782.1330474444.9393.gz&fulltext=1
As sad as it is, those are the same failure we get on a normal try run on. Thanks a lot for testing it. We should be in a good shape to move to 10.7 builders once 721603 lands again.
Nothing else to be done in here. Thanks Rafael to verify it with me.
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: