689592 - updates to build scripts to support jenkins

Status: RESOLVED FIXED

(Tamarin Graveyard :: Build Config, defect, P4)

Description

[Dan Schaffer]

This bug a work item for ongoing experimentation with jenkins to use our current build scripts.

Comment 1

[Dan Schaffer]

Attachment: patch to add support in acceptance tests for writing log in junit xml format

this patch is adding a flag to runtests for saving results in junit xml format.  usage is:  ./runtests.py --showtimes --logjunit=acceptance.xml (--showtimes is optional to provide the time for each test)

Comment 2

[Brent Baker]

test/util/convertAcceptanceToJunit.py is not python3 compatible:
Traceback (most recent call last):
 File "runtests.py", line 57, in <module>
   from util.runtestBase import RuntestBase
 File "../util/runtestBase.py", line 66, in <module>
   from . import convertAcceptanceToJunit
 File "../util/convertAcceptanceToJunit.py", line 20
   str=re.sub(u'[\x00-\x08\x0B-\x0C\x0E-\x1F\x7F]','',str)

Comment 3

[Trevor Baker]

Comment on attachment 562778 [details] [diff] [review]
patch to add support in acceptance tests for writing log in junit xml format

There seems to be an extra dot printed BEFORE in the testcase name.

ie. (see testname .DefaultDynamicClass.as)

Failed

x86-win-tvm-release-Dnodebugger.as3/Definitions/Classes/ClassDef/.DefaultDynamicClass.as (from x86-win-tvm-release-Dnodebugger)

Failing for the past 15 builds (Since #68 )
Took 0.8 sec.
add description
Error Message

   FAILED passes:0 fails:1 unexpected passes: 0 expected failures: 0
Stacktrace

unexpected exit code expected:0 actual:127 Signal Name: Not Found FAILED!
   captured output: avmplus crash: exception 0xC0000005 occurred|Writing minidump crash log to avmplusCrash.dmp|

   FAILED passes:0 fails:1 unexpected passes: 0 expected failures: 0

Comment 4

[Tamarin Bot]

changeset: 6732:0d3188bf9ed0
user:      Dan Schaffer <[e-mail]>
summary:   bug 689592: add --logjunit flag to acceptance tests to write test results to junit xml format (r=trbaker)

http://hg.mozilla.org/tamarin-redux/rev/0d3188bf9ed0

Comment 5

[Tamarin Bot]

changeset: 6746:dd5a8ee68da0
user:      Brent Baker <[e-mail]>
summary:   Bug 706071: Backed out changeset 0d3188bf9ed0 which was pushed for Bug 689592 (inspired by=brbaker, author=fklockii, r=fklockii, pusher=fklockii, further questions=brbaker).

http://hg.mozilla.org/tamarin-redux/rev/dd5a8ee68da0

Comment 6

[Tamarin Bot]

changeset: 6747:59d86dbd7381
user:      Brent Baker <[e-mail]>
summary:   Bug 706071: Merged backout of changeset 0d3188bf9ed0 which was pushed for Bug 689592 (inspired by=brbaker, author=fklockii, r=fklockii, pusher=fklockii, further questions=brbaker).

http://hg.mozilla.org/tamarin-redux/rev/59d86dbd7381

Comment 7

[Tamarin Bot]

changeset: 6754:b442a94598f0
user:      Dan Schaffer <[e-mail]>
summary:   bug 706071: fix bug causing deep hang from runtests.py --timeout=,  original patch is slightly modified from bug 689592 (r=trbaker)

http://hg.mozilla.org/tamarin-redux/rev/b442a94598f0

Comment 8

[Tamarin Bot]

changeset: 7269:254bc717bc49
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: Move the generated binary instead of a coping so that Jenkins will only archive a single shell instead of two.

http://hg.mozilla.org/tamarin-redux/rev/254bc717bc49

Comment 9

[Tamarin Bot]

changeset: 7275:eff2a5b1a09f
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: Add a 'selftest' mode to junit converter, patch taken from the concurrency branch (p=dschaffe)

http://hg.mozilla.org/tamarin-redux/rev/eff2a5b1a09f

Comment 10

[Tamarin Bot]

changeset: 7276:e85efa82b040
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: fix the generated junit report for selftests. Previous code would generate testnames that were not valid

http://hg.mozilla.org/tamarin-redux/rev/e85efa82b040

Comment 11

[Tamarin Bot]

changeset: 7281:78f2b372a525
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: tweak the junit report for selftests so that the tests are all prefixed properly under a selftest toplevel class so that they are grouped together.

http://hg.mozilla.org/tamarin-redux/rev/78f2b372a525

Comment 12

[Tamarin Bot]

changeset: 7294:b4deae0b98ab
user:      Brent Baker <[e-mail]>
summary:   bug 689592: make the cygwin wrapper script work even with windows line endings. This allows the jenkins nodes to have local line endings style in their perforce clientspec.

http://hg.mozilla.org/tamarin-redux/rev/b4deae0b98ab

Comment 13

[Tamarin Bot]

changeset: 7298:d79ade16929a
user:      Brent Baker <[e-mail]>
summary:   bug 689592: make the abcasm.sh script work even with windows line endings. This allows the jenkins nodes to have local line endings style in their perforce clientspec.

http://hg.mozilla.org/tamarin-redux/rev/d79ade16929a

Comment 14

[Tamarin Bot]

changeset: 7305:85be566b75bb
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: update SSH acceptance running scripts to work in the jenkins environment

http://hg.mozilla.org/tamarin-redux/rev/85be566b75bb

Comment 15

[Tamarin Bot]

changeset: 7308:d7f7b3045526
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: fix SSH acceptance running script. vi and emacs settings were causing issues

http://hg.mozilla.org/tamarin-redux/rev/d7f7b3045526

Comment 16

[Tamarin Bot]

changeset: 7311:919276bef983
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: Get android acceptance working via jenkins.

http://hg.mozilla.org/tamarin-redux/rev/919276bef983

Comment 17

[Felix S. Klock II [:pnkfelix, :fklock]]

(In reply to Tamarin Bot from comment #15)
> changeset: 7308:d7f7b3045526
> user:      Brent Baker <[e-mail]>
> summary:   Bug 689592: fix SSH acceptance running script. vi and emacs
> settings were causing issues
> 
> http://hg.mozilla.org/tamarin-redux/rev/d7f7b3045526

(My guess is that the "sh-bang line" (#!/bin/bash) needs to be the very first line, and the vi and emacs settings should come after it.)

Up to you whether you want to try that alternative to removing the lines entirely.

Comment 18

[Tamarin Bot]

changeset: 7322:2c39dbbf80e7
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: ssh clients need to validate the deployed shell using either the passed in p4 changelist or find the p4 changelist number in the passed in hg revision description text.

http://hg.mozilla.org/tamarin-redux/rev/2c39dbbf80e7

Comment 19

[Tamarin Bot]

changeset: 7324:ea45e24ffa06
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: Add the ability to specify the directory in which to compile the shell during the automated build

http://hg.mozilla.org/tamarin-redux/rev/ea45e24ffa06

Comment 20

[Tamarin Bot]

changeset: 7326:ba7ae027ea70
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: no slaves should be setting MAKE_OPTIONS via the environment.sh script any more, all of those settings should be set via the node in Jenkins

http://hg.mozilla.org/tamarin-redux/rev/ba7ae027ea70

Comment 21

[Brent Baker]

Attachment: Jenkins deep builds for desktop

Moving compilation and testing that used to happen in the buildbot deep phase into a jenkins job.

Comment 22

[Tamarin Bot]

changeset: 7357:0b83b4de7e78
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: Update build scripts to move the deep phase of the autobuild into Jenkins.

http://hg.mozilla.org/tamarin-redux/rev/0b83b4de7e78

Comment 23

[Tamarin Bot]

changeset: 7359:08202a22e301
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: Tweaks to get deep phase of the CB working correctly via jenkins.

http://hg.mozilla.org/tamarin-redux/rev/08202a22e301

Comment 24

[Tamarin Bot]

changeset: 7367:b2919d6a1e50
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: additional tweak for dep phase of the CB

http://hg.mozilla.org/tamarin-redux/rev/b2919d6a1e50

Comment 25

[Brent Baker]

Attachment: deep phase FIXMEs addressed

Comment 26

[Brent Baker]

I am now going to close this bug as we have moved away from buildbot completely and have the build system running in Jenkins.

Comment 27

[Tamarin Bot]

changeset: 7377:63ae8da654ba
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: Address the FIXMEs in the build deep phase. (r=brbaker)

http://hg.mozilla.org/tamarin-redux/rev/63ae8da654ba

Comment 28

[Tamarin Bot]

changeset: 7383:ec8b3e0dbcd2
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: Fix 32 vs 64 bit differenatial testing on windows64 in the deep build

http://hg.mozilla.org/tamarin-redux/rev/ec8b3e0dbcd2

Comment 29

[Tamarin Bot]

changeset: 7414:6f1941f94119
user:      Brent Baker <[e-mail]>
summary:   Bug 689592: Make sure to set the config string to a 'debug' build for the linux-mips debug interp acceptance run in the deep phase of the build (r=brbaker)

http://hg.mozilla.org/tamarin-redux/rev/6f1941f94119