759330 - update config.py to support new talos tests and updated tp5 zip

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

we will have a lot of new tests coming online to replace old ones.  On m-c we will be replacing tp5row with tpn, svg with svgr, chrome with chromer, chrome_mac is going away, and we will be adding other and other_mac.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: updated configs to do side by side for row major and tp5n (1.0)

FYI, this depends on a series of other patches to land, but I want to get this resolved first.

Comment 2

[Armen [:armenzg]]

Want me to review this?

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 627973 [details] [diff] [review]
updated configs to do side by side for row major and tp5n (1.0)

yeah, if you could

Comment 4

[Armen [:armenzg]]

Comment on attachment 627973 [details] [diff] [review]
updated configs to do side by side for row major and tp5n (1.0)

Review of attachment 627973 [details] [diff] [review]:
-----------------------------------------------------------------

I can land it now if you think we are ready to go.

::: mozilla-tests/config.py
@@ +307,5 @@
> +    },
> +    'svgr': {
> +        'enable_by_default': False,
> +        'suites': GRAPH_CONFIG + ['--activeTests', 'tsvgr:tsvgr_opacity', '--filter', 'ignore_first:5', '--filter', 'median'],
> +        'options': ({}, ALL_PLATFORMS),

Missing "},"

Comment 5

[Armen [:armenzg]]

Comment on attachment 627973 [details] [diff] [review]
updated configs to do side by side for row major and tp5n (1.0)

r+ with missing "}," and after I confirm my run on staging.

I am running this with a fed64 slave.
If you want more than that let me know.

Comment 6

[Armen [:armenzg]]

I had some trouble on Friday with talos-r3-fed64-002 and started the runs late on Friday.

By looking at:
http://tinderbox.mozilla.org/showbuilds.cgi?tree=MozillaTest&maxdate=1338605457&hours=24&legend=0&norules=1

We have few failures from talos-r3-fed64-010. I have re-triggered those and any jobs that talos-r3-fed64-002 took (which we assume incorrect).
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1338587146.1338590944.27597.gz&fulltext=1
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1338582011.1338583345.13249.gz&fulltext=1

Comment 7

[Armen [:armenzg]]

BTW, should any of these new suites be pointing to a newer talos.zip? (just checking).

There are now 3 jobs pending.

tp5row failed again (I have triggered it once more):
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1338825502.1338830700.11075.gz&fulltext=1

Failed tp5row: 
		Stopped Mon, 04 Jun 2012 10:23:48
Traceback (most recent call last):
  File "run_tests.py", line 580, in run_tests
    browser_dump, counter_dump, print_format = mytest.runTest(browser_config, test)
  File "/home/cltbld/talos-slave/talos-data/talos/ttest.py", line 427, in runTest
    self.cleanupAndCheckForCrashes(browser_config, profile_dir)
  File "/home/cltbld/talos-slave/talos-data/talos/ttest.py", line 194, in cleanupAndCheckForCrashes
    raise talosError("stack found after process termination (" + cleanup_result+ ")")
talosError: 'stack found after process termination (firefox-bin(2259): terminated with SIGABRT)'
Traceback (most recent call last):
  File "run_tests.py", line 640, in <module>
FAIL: Busted: tp5row
FAIL: stack found after process termination (firefox-bin(2259): terminated with SIGABRT)
    main()
  File "run_tests.py", line 637, in main
    run_tests(parser.config)
  File "run_tests.py", line 591, in run_tests
    raise e
utils.talosError: 'stack found after process termination (firefox-bin(2259): terminated with SIGABRT)'
program finished with exit code 1
elapsedTime=3687.709497

Comment 8

[Joel Maher ( :jmaher ) (UTC -8)]

the talos.zip is uploaded and checked into m-c, I believe you are good to go if the other tests are running.

Comment 9

[Armen [:armenzg]]

No other redness besides tprow which has failed 3 times in a row.
Maybe I should try another revision?

Comment 10

[Joel Maher ( :jmaher ) (UTC -8)]

odd that tp5row is dying as nothing was really changed related to that.  Lets try another revision and I will look on tbpl for fed64 tp5row results to see what to expect.

Comment 11

[Armen [:armenzg]]

A 3rd slave managed to pass tprow.
I say we're good.

Comment 12

[Armen [:armenzg]]

Comment on attachment 627973 [details] [diff] [review]
updated configs to do side by side for row major and tp5n (1.0)

Landed on "default":
789f91b85aac

Let's see if with release day we can do reconfigures or not.

Comment 13

[Armen [:armenzg]]

This is now live.