Closed Bug 834737 Opened 7 years ago Closed 7 years ago
2 text reftests fail while running unitests on ubuntu 12
.04 on ec2 VMs
we are working on scaling our test infrastructure and this includes virtual machines on amazon ec2. We have tests running and a few are failing. There are two text related reftests which fail: log: https://tbpl.mozilla.org/php/getParsedLog.php?id=19103276&tree=Cedar tests: 13:51:40 INFO - REFTEST TEST-UNEXPECTED-PASS | file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/text/475092-pos.html | image comparison (==) 13:52:08 INFO - REFTEST TEST-UNEXPECTED-FAIL | file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/text-decoration/underline-button-2.html | image comparison (==), max difference: 216, number of differing pixels: 58 tbpl view for reftest analyzer: https://tbpl.mozilla.org/?tree=Cedar&rev=706f8a9ee780
underline-button-2 already fails-if(winWidget). "the underline spacing inside the button is different" sounds like the same thing. Perhaps using the same font inside and outside the button might help, but I'm surprised if the underline spacing for a button can come from the font outside the button.
The difference in 475092-pos may be due to bytecode/autohinter differences (Bug 482596 comment 12). If we switch atomically, it can be marked as passing I guess. Otherwise, random-if(gtk2Widget).
So the issue is basically that in one case the button is drawing the underline while in the other case the <span> is, iirc. They're drawing it on the same text but for some reason end up with differences in the underline vertical position... And yes, the Windows issue was the same. We should definitely try forcing the same font inside and outside the button to see if that hepls.
how can I force the font inside and outside the button? Is there a pref or a change to the test I can do? If this doesn't work I can fix with manifests for gtk2Widget.
Just setting font-family and font-size to the same value (e.g. 'sans-serif') on both the button and the <span> in the test should work. So toss style="font: 16px sans-serif" on both elements?
this style fix resolves the case for the file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/text-decoration/underline-button-2.html test! :karlt, should we mark the file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/text/475092-pos.html as random-if until we can only run on ubuntu vms instead of fedora machines?
1) the underline-button problem is fixed as per the suggestion 2) 475092-pos.html is random-if(gtk2Widget) We should land this bug and [leave open] until we switch to ubuntu for all reftests. This will allow us to remove the random-if statement.
Assignee: nobody → jmaher
Status: NEW → ASSIGNED
Attachment #709833 - Flags: review?(bzbarsky)
> this style fix resolves the case for the underline-button-2.html test! Excellent. Maybe it fixes on Windows too, so we can enable the test there?
Comment on attachment 709833 [details] [diff] [review] fix the two problems outlined in this test (1.0) r=me
Attachment #709833 - Flags: review?(bzbarsky) → review+
Setting font family and size for the button made underline-button-2 pass on WINNT. https://tbpl.mozilla.org/?tree=Try&rev=57a4eeebffcb
(In reply to Joel Maher (:jmaher) from comment #6) > :karlt, should we mark the > file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/text/ > 475092-pos.html as random-if until we can only run on ubuntu vms instead of > fedora machines? (In reply to Joel Maher (:jmaher) from comment #7) > We should land this bug and [leave open] until we switch to ubuntu for all > reftests. This will allow us to remove the random-if statement. Sounds good, thanks.
Whiteboard: [leave open]
now that we are running reftests on ubuntu VM's and not on Fedora machines anymore, we can mark this as fails-if to ensure quality coverage.
Attachment #720002 - Flags: review?(bzbarsky)
Whiteboard: [leave open]
Comment on attachment 720002 [details] [diff] [review] mark random-if reftest from previous patch as fails-if (1.0) r=me
Attachment #720002 - Flags: review?(bzbarsky) → review+
Backed out for: https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=491d60eb44bf&jobname=reftest 05:29:12 INFO - REFTEST TEST-UNEXPECTED-PASS | file:///builds/slave/test/build/tests/reftest/tests/layout/reftests/text/475092-pos.html | image comparison (==) https://hg.mozilla.org/integration/mozilla-inbound/rev/9b52f3a5b53b
this test continually passes on the ubuntu testers, so lets mark it as passing!
Comment on attachment 725006 [details] [diff] [review] mark test as passing since this passes on linux (2.0) r=me
Attachment #725006 - Flags: review?(bzbarsky) → review+
Status: ASSIGNED → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla22
You need to log in before you can comment on or make changes to this bug.