589462 - Apparent moving away from 2K3 tests

Status: RESOLVED DUPLICATE of bug 614955

(Release Engineering :: General, defect, P3)

Description

[Bas Schouten (:bas.schouten)]

So, it seems currently there's no more 2K3 optimized tests running anymore.

I'd like to raise attention to some issues here:

- The WINNT 5 and WINNT 6.x kernels are quite different. Only running tests on Windows 7 will most certainly not guarantee all the tests pass on Windows 2K3/XP. We've seen this in the past when we added Windows 7 tests, and found new intermittents/failures which were never there on Win2K3.
- The Windows 7 boxes currently are running D2D-based. Since D2D is on by default for DX10 hardware and these boxes run DX10 hardware. That means we either need to run explicit Windows 7-GDI tests, or we're not testing GDI -at all-, which for the time being is the majority of our users. (Yes, this means reftest-d2d is currently pretty pointless now that it's on by default)
- Even if we have Windows 7 boxes running GDI tests there's been differences between Windows XP GDI behavior and Windows 7 GDI behavior, particularly in the font department.

I'm not sure if we have the required test coverage with just Windows 7 tests running! Windows XP is still a large portion of our user base.

Comment 1

[Jeff Muizelaar [:jrmuizel]]

My understanding was that the plan was to switch from testing on 2003 to testing on XP.

Comment 2

[Bas Schouten (:bas.schouten)]

(In reply to comment #1)
> My understanding was that the plan was to switch from testing on 2003 to
> testing on XP.

That sounds fine, at the moment I'm seeing only performance tests being run on XP though, nothing else.

Comment 3

[Armen [:armenzg]]

Thanks for bringing this to our attention.
It would have been to have known this before so we would have put more emphasis on running the tests on XP but as of now we have to deploy VC 2005 SP1 redist on those machines so we can run unit tests on them.