581213 - Run reftests with Direct3D 9 accelerated layers on Windows desktop platform

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[Joe Drew (not getting mail)]

Just like bug 580410 - we need to automatically run our reftests with Direct3D 9 accelerated layers. First step is to make sure that they run through to completion, which I will take on before tossing this to RelEng.

Comment 1

[Joe Drew (not getting mail)]

Here's the way to run with hardware acceleration:

    export MOZ_ACCELERATED=11
    make reftests

Everything should 'just work' more or less (of course right now we get reftest
failures).

Comment 2

[Armen [:armenzg]]

I should get to this before the end of the week.

My understanding is that this has higher priority than bug 580410 and that is why I will tackle this first.

Comment 3

[Armen [:armenzg]]

I am going to enable OpenGL as well on the patch for this bug.

Tons of oranges but it seems that my patches are getting the job done.
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1281723827.1281724773.25470.gz&fulltext=1

I will have to get my hands on a staging environment for several hours (I could only borrow one for a short time) to make sure that all the suites requested run on all platforms.

Comment 4

[Armen [:armenzg]]

Attachment: WIP [buildbotcustom] add Direct 3D 9 and OpenGL suites

Comment 5

[Armen [:armenzg]]

Attachment: WIP [buildbot-configs] add Direct 3D 9 and OpenGL test suites plus a11y for macosx

These patches have run through staging but as I mentioned on my previous comment. I want to make sure it runs for all platforms rather than just Linux64.

This patch also enables a11y for macosx which is wanted on bug 524775 and I willing to test it.

Comment 6

[Chris AtLee [:catlee]]

Comment on attachment 465767 [details] [diff] [review]
WIP [buildbot-configs] add Direct 3D 9 and OpenGL test suites plus a11y for macosx

Looks sane.  I'm not keen on 'OpenGL' - 'opengl' would be more consistent with the rest of our names.

Comment 7

[Chris AtLee [:catlee]]

Comment on attachment 465766 [details] [diff] [review]
WIP [buildbotcustom] add Direct 3D 9 and OpenGL suites

Same comments about uppercase names vs. lowercase.  I think keeping them all lower case is cleaner.

Comment 8

[Armen [:armenzg]]

Could you guys please have a look at this Direct 3D run and tell me if it looks alright?
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1281969809.1281970795.8356.gz

Comment 9

[Armen [:armenzg]]

(In reply to comment #8)
> Could you guys please have a look at this Direct 3D run and tell me if it looks
> alright?
> http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1281969809.1281970795.8356.gz

The correct log is:
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTest/1281973439.1281974524.25694.gz

Comment 10

[Armen [:armenzg]]

Attachment: [buildbotcustom] Add steps for direct3d and opengl

I have correct the naming.

Comment 11

[Joe Drew (not getting mail)]

There are curiously few failures in this log, but the failures aren't known so it's probably just fine! Let's go ahead with this.

Comment 12

[Armen [:armenzg]]

Attachment: [buildbot-config] add direct3d for win32 and opengl for Mac and Linux (all but 10.6)

This patch leaves the a11y suite *not* being run for Mac since it did not work (more info on bug 524775).
(The way of disabling is a little unorthodox. I welcome suggestions)

I chatted with joe and we are going to keep 10.6 without this test suite until they can loan a 10.6 machine from us to see why the test suite did not run correctly (see bug 580410 for more details). Having it enabled would have wasted CPU time since the job would only finish after 330 seconds timeout.

Comment 13

[Armen [:armenzg]]

Attachment: [configs] enable OpenGL for Fedora and Direct3D for Windows

The difference with the previous patch is that we won't enable OpenGL for 10.5 until we figure out the issues with regard the resolution.

This also deals with the unorthodox way of getting read of a11y test suite for Mac.

Comment 14

[Armen [:armenzg]]

Attachment: [configs] enable OpenGL for Fedora and Direct3D for Windows

OK this should address your last comment on IRC with regards of making it a little more general (NOTE we can generalize even more but this does what we need now).

Again, I am only adding new test suites for Fedora and Windows.

I would like to deploy this on tomorrow's downtime if possible.

Comment 15

[Armen [:armenzg]]

Comment on attachment 466397 [details] [diff] [review]
[buildbotcustom] Add steps for direct3d and opengl

http://hg.mozilla.org/build/buildbotcustom/rev/994771f2d07f

Comment 16

[Armen [:armenzg]]

Comment on attachment 466826 [details] [diff] [review]
[configs] enable OpenGL for Fedora and Direct3D for Windows

http://hg.mozilla.org/build/buildbot-configs/rev/77df5479bcc9

Comment 17

[Armen [:armenzg]]

This has been deployed.

I have kept the test suite hidden on the Firefox tree until the GFX team brings down the count of permanent oranges to zero. AFAIK it is now on GFX's hand to keep track of these oranges and fix them (bug 586460).
If you find any infrastructure problem please file a separate bug or reopen this one.

Once the test suite is free of permanent oranges please go ahead and un-hide it. By then we should have bug 588454 fixed which currently prevents us from showing on TBPL this test suite.

Ping me on IRC or comment on this bug if you have any following questions.

AFAIK this is RESOLVED FIXED.

Comment 18

[Joe Drew (not getting mail)]

This is perfect, Armen. Thank you.