Sisyphus - tinderbox log html snippets

RESOLVED FIXED

Status

Testing
Sisyphus
RESOLVED FIXED
11 years ago
10 years ago

People

(Reporter: bc, Assigned: bc)

Tracking

Trunk
x86
All
Points:
---
Bug Flags:
in-testsuite -

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(3 attachments, 2 obsolete attachments)

(Assignee)

Description

11 years ago
Tinderbox uses html snippets at the end of the build logs of the form:

TinderboxPrint: some html

to display summary info in the waterfall boxes. Something like these need to be added to the logs Sisyphus generates.
Flags: in-testsuite-
Flags: in-litmus-
(Assignee)

Comment 1

11 years ago
Rob, how should I handle links to log files in these snippets? Where will the log files live and what kinds of names will they have? 
(Assignee)

Updated

11 years ago
Assignee: nobody → bclary
(Assignee)

Comment 2

11 years ago
Rob, what do you think about this for the near term?

The log would contain (for example):

JavaScript Test Failures:

TEST_ID=e4x/Expressions/11.1.4-08.js, TEST_BRANCH=1.9.0, TEST_RESULT=FAILED, TEST_BUILDTYPE=debug, TEST_TYPE=browser, TEST_OS=win32, TEST_MACHINE=qm-winxp03, TEST_PROCESSORTYPE=unknown, TEST_KERNEL='1.5.24(0.156/4/2)', TEST_DATE=2007-11-23-23-54-34-0500, TEST_TIMEZONE=-0500, TEST_DESCRIPTION=Section 50 of test - 11.1.4 - XML Initializer - {} Expressions - 08 expected: true actual: false reason: Expected value 'true', Actual value 'false'
...

JavaScript Test Possible Fixes:

TEST_ID=e4x/XML/regress-324422-1.js, TEST_BRANCH=1.9.0, TEST_RESULT=FAILED, TEST_BUILDTYPE=(debug|opt), TEST_TYPE=browser, TEST_OS=(linux|mac|win32), TEST_MACHINE=.*, TEST_PROCESSORTYPE=.*, TEST_KERNEL=.*, TEST_DATE=.*, TEST_TIMEZONE=.*, TEST_DESCRIPTION=BUGNUMBER: 324422; STATUS: Do not crash creating XML object with long initialiser; STATUS: 10485760
...

JavaScript Test Possible Regressions:

TEST_ID=e4x/XML/regress-324422-1.js, TEST_BRANCH=1.9.0, TEST_RESULT=FAILED, TEST_BUILDTYPE=debug, TEST_TYPE=browser, TEST_OS=win32, TEST_MACHINE=qm-winxp03, TEST_PROCESSORTYPE=unknown, TEST_KERNEL='1.5.24(0.156/4/2)', TEST_DATE=2007-11-23-23-54-34-0500, TEST_TIMEZONE=-0500, TEST_DESCRIPTION=Do not crash creating XML object with long initialiser Section  expected:  actual: error reason: script stack space quota is exhausted Page: http://test.mozilla.com/tests/mozilla.org/js/e4x/XML/regress-324422-1.js Line: 65


TinderboxPrint: js tests npass/nfail<br/>F:npossiblefixes<br/>R:npossibleregressions

each of the sections listing test results|known failure patterns would at the most be a few hundred lines (especially on 1.8) and nothing like the many thousands of lines currently being sent to the master.
Status: NEW → ASSIGNED
yeah, that sounds ideal. I just noticed that we're not currently printing the contents of the fixes and regressions logs under -v either. I'll see what I can do about trimming the logs through buildbot and only printing failures in the meantime.
(Assignee)

Comment 4

11 years ago
I think I can have a fix for the new option this morning. Don't spend too much time on getting buildbot to work around it.
(Assignee)

Comment 5

11 years ago
Created attachment 290463 [details] [diff] [review]
patch
Attachment #290463 - Flags: review?(rcampbell)
Attachment #290463 - Flags: review?(rcampbell) → review+
(Assignee)

Comment 6

11 years ago
Checking in runtests.sh;
/cvsroot/mozilla/js/tests/runtests.sh,v  <--  runtests.sh
new revision: 1.4; previous revision: 1.3
done
Status: ASSIGNED → RESOLVED
Last Resolved: 11 years ago
Resolution: --- → FIXED
(Assignee)

Comment 7

11 years ago
Created attachment 290467 [details] [diff] [review]
patch 2

The previous patch left filenames from the wc -l which are a pita I think. This should fix it. I'll attach sample output next.
Attachment #290467 - Flags: review?(rcampbell)
(Assignee)

Comment 8

11 years ago
Created attachment 290468 [details]
sample output
(Assignee)

Comment 9

11 years ago
fyi, I corrected locally the misspelling of Possible in the TinderboxPrint line.
Comment on attachment 290467 [details] [diff] [review]
patch 2

looks good!
Attachment #290467 - Flags: review?(rcampbell) → review+
oh yeah, I see what you mean by the filenames...

js tests 50549/0 /work/mozilla/mozilla.com/test.mozilla.com/www/results/2007-11-28-16-52-10-0800,js,1.9.0,debug,linux,qm-jstest01,tests_mozilla.org_js.log-results-failures.log
F:36 /work/mozilla/mozilla.com/test.mozilla.com/www/results/2007-11-28-16-52-10-0800,js,1.9.0,debug,linux,qm-jstest01,tests_mozilla.org_js.log-results-possible-fixes.log
R:0 /work/mozilla/mozilla.com/test.mozilla.com/www/results/2007-11-28-16-52-10-0800,js,1.9.0,debug,linux,qm-jstest01,tests_mozilla.org_js.log-results-possible-regressions.log
js tests 50550/0 /work/mozilla/mozilla.com/test.mozilla.com/www/results/2007-11-28-17-02-16-0800,js,1.9.0,opt,linux,qm-jstest01,tests_mozilla.org_js.log-results-failures.log
F:36 /work/mozilla/mozilla.com/test.mozilla.com/www/results/2007-11-28-17-02-16-0800,js,1.9.0,opt,linux,qm-jstest01,tests_mozilla.org_js.log-results-possible-fixes.log
R:0 /work/mozilla/mozilla.com/test.mozilla.com/www/results/2007-11-28-17-02-16-0800,js,1.9.0,opt,linux,qm-jstest01,tests_mozilla.org_js.log-results-possible-regressions.log 

I'll turn this off for now until patch2 gets checked in
(Assignee)

Updated

11 years ago
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
(Assignee)

Comment 12

11 years ago
Created attachment 290557 [details] [diff] [review]
patch v3

This should be it I think.
Attachment #290467 - Attachment is obsolete: true
Attachment #290557 - Flags: review?(rcampbell)
(Assignee)

Comment 13

11 years ago
Created attachment 290558 [details]
sample output
Attachment #290468 - Attachment is obsolete: true
(Assignee)

Updated

11 years ago
Attachment #290467 - Flags: review+
Attachment #290557 - Flags: review?(rcampbell) → review+
(Assignee)

Comment 14

11 years ago
Checking in runtests.sh;
/cvsroot/mozilla/js/tests/runtests.sh,v  <--  runtests.sh
new revision: 1.5; previous revision: 1.4
done

Ok, that ends this bug.
Status: REOPENED → RESOLVED
Last Resolved: 11 years ago11 years ago
Resolution: --- → FIXED
Mass move of Sisyphus bugs to Testing : Sisyphus. Filter on SisyphusMassMove to ignore.
Component: Testing → Sisyphus
Flags: in-litmus-
Product: Core → Testing
QA Contact: testing → sisyphus
You need to log in before you can comment on or make changes to this bug.