Closed Bug 410460 (acid3) Opened 16 years ago Closed 13 years ago

Acid3 tracking bug

Categories

(Core Graveyard :: Tracking, defect)

defect
Not set
normal

Tracking

(Not tracked)

VERIFIED FIXED

People

(Reporter: Gavin, Unassigned)

References

(Depends on 1 open bug, )

Details

(Keywords: meta, Whiteboard: read #111 #126 and #128 BEFORE commenting)

Work has begun on the Acid3 test. The work-in-progress is at the URL in the URL field. Despite the scary warnings we should look into the parts of it that are failing and get bugs filed with testcases if there aren't already.
Keywords: meta
Version: unspecified → Trunk
This is probably easiest to track in a spreadsheet.  I started one to deal with
the individual tests in this:

http://spreadsheets.google.com/pub?key=pNgBCwWdyRTT2JeiZn4B2Yw

A link to edit it's at the bottom of the page.  Currently Gavin and I have edit
access; ask him if you want to be able to edit it.
Can you give me access?

Tests 4 up to 8 are bug 132824
Depends on: 132824
It's not obvious, but clicking on the "Acid3" title will alert a list of the tests that failed.
It's in the comments but it's worth to put here:
click on the "A" of the title - no other letter will give you the list.

Shift-click the "A" to get the report on the current page, instead of an alert.
Depends on: 261081
Depends on: 411103
Depends on: 98997
Depends on: 254337
Depends on: 42976
Depends on: 157373
Depends on: strongparent
Depends on: 302775
Depends on: 366944
Depends on: mediaqueries
Depends on: 118704
Depends on: 260106
Depends on: 411889
Depends on: 411893
Depends on: text-shadow
No longer depends on: 410472
Can someone with the appropriate rights please add Bug 73586 – matching of :first-child, :only-child, and :last-child not dynamically updated [SELECTORS-DYNAMIC] to the dependencies?
Tests 35-37 fail due to that bug.
Depends on: 73586
With acid3, the browser locks up for a bit on the 14% before continuing. is this a javascript bug?
It's some inefficiency (specific area of functionality not currently known) as acid3 does its best to force a garbage collection; I suspect it'll get improved some with the current and ongoing perf work.  However, I personally doubt it'll get a *huge* amount of specific attention in the immediate future, at least until the low-hanging fruit (of which there's still plenty, in my estimation) in acid3 is fixed, as no real-world page is actually going to do what's being done there.

Also, given the current point in the release cycle, acid3 is extremely unlikely to be fixed in Firefox 3, so nobody who hacks on Firefox full-time is likely to spend much time on it now, except coincidentally.
Depends on: 346690
Depends on: 412567
Depends on: 70132
Depends on: 413155
Depends on: 312354
Tests 26,27 and 73 appear to pass...
26 and 27 are passing for me, but not 73.

Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9b3pre) Gecko/2008013104 Minefield/3.0b3pre
26/27 don't pass when I run them.  The reason people are reporting different things is that the test basically relies on a garbage collection happening, but I think that behavior's going to be system-dependent to an extent, and it might just be that some systems don't GC in the right period of time.

I also see 73 passing; for now I've marked it as a yellow PASS that we can revisit later to figure out what's up.
New URL for the "final": http://acid3.acidtests.org/
per http://www.css3.info/acid3-completed/

Acid and Acid2 are hosted there now, too.
(In reply to comment #11)
> per http://www.css3.info/acid3-completed/

Sure.  Note, however, that despite what the site says, acid3 isn't yet completed, and it's still changing for a little while longer.
Booted off of a drive with Tiger on it, (Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.4; en-US; rv:1.9b3pre) Gecko/2008020204 Minefield/3.0b3pre), I get the opposite of what I had before: 26 and 27 failing, 73 passing. Is there a chance this is a Tiger/Leopard issue?
No longer depends on: 413155
FWIW Test 26/27 fail and 73 passes with Webkit r30377 on Intel Leopard, so it looks likely to be a Firefox Issue
Just wondering why the windows builds are currently at 66/100, and my newly compiled linux build is at 65/100, why would there be a difference?
Depends on: 119490, 216462
Depends on: 287465
Even on Windows there's sometimes a difference of 1 point. Last week I noticed test #80 somtimes failed and sometimes did not fail. However, it looks like this test was changed recently as well.
Sounds like the Acid3-test has officially been released: 
www.webstandards.org/press/releases/20080303/
www.webstandards.org/acid3/
It looks like test 42 in the test is broken.  The selector it uses is:
        var match = add("#div1 ~ div div + div > div");
but the content tree it constructs would match
        var match = add("#div1 ~ div + div div > div");
we are falling behind webkit. they can do 90 of the tests while we only can do 66. we need to look at their code and see how things work there.
We need to ship Firefox 3 and Gecko 1.9.
Depends on: 352044
Depends on: 421546
No longer depends on: 421546
Depends on: 421576
Flags: in-litmus?
(In reply to comment #20)
> we are falling behind webkit. they can do 90 of the tests while we only can do
> 66. we need to look at their code and see how things work there.
> 

66?  I got 60 completed on FF3b3 on Linux, and that's the highest I've seen.  When I tried the first time, it was 57.  One of my friends tried WebKit on his Mac, and it was 83, not 90.
(In reply to comment #22)
> 66?  I got 60 completed on FF3b3 on Linux, and that's the highest I've seen. 
> When I tried the first time, it was 57.  One of my friends tried WebKit on his
> Mac, and it was 83, not 90.
> 

Well on:

Mozilla/5.0 (Windows; U; Windows NT 5.2; en-US; rv:1.9b5pre) Gecko/2008030806 Minefield/3.0b5pre ID:2008030806

I get 69/100.

But could we keep this discussion to some forum ( e.g mozillazine ). It's not really worthy bug talk unless we expect to be getting some particular score and we're not.
69 on Linux, today's build.
we need a rule for this acid test no posting number unless it has gone down or up or something like that
Depends on: 421765
Depends on: 421767
Depends on: 421131
I think no one cares if this cames 1 month later or sooner... the important is that it cames free of bugs... 

if there is a bug then it should be fixed before the final release.

And passing the Acid3 Test would be great, would bring confidence to users and would make a lot of publicity to Firefox (specially if it was the first browser to do so!)
Please move this kind of discussion to mozillazine forums as this bug is only a tracking bug and should be kept concise if possible : http://forums.mozillazine.org/viewtopic.php?t=634633&postdays=0&postorder=asc&postsperpage=15&start=0
I have a feeling that some features required to pass the test won't be added until Gecko 2 is out. Am I correct?
yes you are josh the only way Firefox 3 could pass would be if we delayed Firefox 3 till early 2009 at the earliest 
(In reply to comment #29)
> yes you are josh the only way Firefox 3 could pass would be if we delayed
> Firefox 3 till early 2009 at the earliest

Actually, Gecko 2 will be in Firefox 4.
Please don't spam this bug with discussions about its progress, progress that may happen or happend already and avoid discussing topics that are only slightly related to this bug at all, like the next iteration of Gecko/Firefox.

These topics are best discussed in the forums of MozillaZine.org Here's the Acid3 Topic: http://forums.mozillazine.org/viewtopic.php?t=634633

Vote or CC to this Bug if you want to follow its progress. Spamming the bug will only annoy the devs and those who already voted or CCd to follow its progres (like me). Thank you.

I apology for my own spam. Sorry.
Using Firefox 3.0b4 under Windows XP PRO SP2 it shows inconsistent behavior.
More specifically I get 67/100 score 75% of the time and a 68/100 a 25%.

On those times that I get the 67 the extra test that fails is:
"Test 80 failed: kungFuDeathGrip is null"

I also noticed that the tests that have a 67 last 0.45 to 0.55 seconds while the ones that score 68/100 last at least 0.70 (in one instant I got a full 2.43!)
(In reply to comment #32)
> Using Firefox 3.0b4 under Windows XP PRO SP2 it shows inconsistent behavior.
> More specifically I get 67/100 score 75% of the time and a 68/100 a 25%.
> On those times that I get the 67 the extra test that fails is:
> "Test 80 failed: kungFuDeathGrip is null"
> I also noticed that the tests that have a 67 last 0.45 to 0.55 seconds while
> the ones that score 68/100 last at least 0.70 (in one instant I got a full
> 2.43!)

This might actually be caused because of your cache. Reset it by pressing F5 and Ctrl at the same time. Tis happened to me on Minefield. It came up with a score of 70/100. After, I downloaded the latest build. I then went back on Acid3 and it was still 70, but a wikipedia article said it was 71, so I reset the cache and it was 71.
(In reply to comment #33)
You know, this probably was it. I did it and now I get 78 systematically!

Great, thanks!
Erm, I meant 68...
In addition to not supporting downloadable fonts, the "X" with fuchsia background is not positioned correctly. It should cover up the red square in the top right corner. This is the CSS code in question, formatted for readability:

  map::after { 
      position: absolute; 
      top: 17px; 
      left: 639px; 
      content: "X"; 
      background: fuchsia; 
      color: white; 
      font: 20px/1 AcidAhemTest;
  }
I think it's important to sort out the visual errors first. They'll be out of the way then.
according to ref. rendering, "X" shouldn't show up. I don't know.
whoops. sorry. the red x is in bug 70132.

I'm very sorry about rapid bug modification.
Allow me to explain. The acid3 test has it's own font called "acidfont" or something like that. CSS 3 allows browsers to download fonts. The "acidfont" is basically a square. It gets coloured white via the CSS and the square will cover the red square at the top right corner, making it invisible. WebKit has successfully done this, but the square is also covering up the border. (see wikipedia)
(In reply to comment #1)
> This is probably easiest to track in a spreadsheet.  I started one to deal with
> the individual tests in this:
> 
> http://spreadsheets.google.com/pub?key=pNgBCwWdyRTT2JeiZn4B2Yw


Test 78 fails due to lack of support SVG fonts. Our implementation of |textPath| and |getRotationOfChar| seems O.K. for Acid3.
Naw.. It gives 0 when the test expects 90. wont work.
If anyone's interested. Presto (Opera) and Safari (WebKit) have passed Acid3, except for one glitch: they don't display the animation smoothly.
> except for one glitch: [...]

And the fact that at least WebKit has introduced a special case for the Acid3 font:
m_allowFontSmoothing = (nameStr != "Ahem");
Not something I'd like to see in the source repository.

I hope that instead of aiming for a 100/100 and a perfect test rendering that we still look at how far a fix benefits/hurts the web as a whole, carefully judging the pros and cons.
Depends on: 424973
in-litmus+:

https://litmus.mozilla.org/show_test.cgi?id=5260

(Note that the testcase is currently disabled, and will remain so until I or someone else is aware of the expected passing-percentage for a given release.)
Flags: in-litmus? → in-litmus+
I see no test for cloneNode on documents in Acid3, removing that from dependency list.
No longer depends on: 42976
Actually, the Range.cloneContents test will depend on Document.cloneNode, but we're not getting there yet because of bug 302775. Sorry for the bugspam.
Depends on: 42976
Depends on: 75375, 128585
No longer depends on: 424973
Depends on: 437915
Depends on: 438996
Depends on: 426027
Depends on: 443648
Depends on: 446248
Depends on: 446584
Depends on: 448129
No longer depends on: 446248
Flags: wanted1.9.1?
No longer depends on: 433662
I enabled the litmus test for the 3.1 branch with note referencing this bug.  It's in the FFT, this will get run much less often than if in the BFT's.  I left the 3.0 test case disabled. (assuming fixes might not make it back there)
No longer depends on: 425432
A brief update on current status (which I wrote in https://wiki.mozilla.org/Platform/2008-09-09#Layout_1.9.1_Update but should probably also put here):

    * numeric tests
          o trunk now to 85/100
          o patches currently in bugs get us to 90/100
                + bug 302775, bug 366944, bug 42976, bug 433533, bug 174351 
          o missing 1 point for bug 446584 (which had patch that stopped working)
          o missing 2 points for range bugs: (bug 454325, bug 454326)
          o missing 2 points for SMIL in SVG (bug 216462)
          o missing 3 points for SVG fonts and other related SVG issues (some
              might be easy)
          o missing 1 point for bug 450160 (createDocument)
          o missing 1 point for bug 178258 (HTML parser)
          o intermittently missing 1 or 2 points for bug 335998 (GC timing and
              nodes owning parents) 
    * layout tests
          o roc fixed stuff related to positioning and the root element
          o only remaining layout failure is downloadable TTF fonts
Good to see the progress. Just a quick reminder: The Acid3 test also has a "smoothness" criterion that needs to pass before this bug is resolved.
Depends on: 434269
No longer depends on: 366944
Another status update:

Numeric tests:
 * trunk now at 86/100
 * patches currently in bug 302775, bug 42976, bug 433533, bug 174351,
   and bug 454325 get us to 93/100
 * missing 2 points (#75, #76) for SMIL in SVG (bug 216462)
 * missing 3 points (#77, #78, #79) for SVG fonts and other related SVG
   issues (some might be easy)
 * missing 1 point (#98) for bug 450160 (createDocument making HTML doc)
 * missing 1 point (#71) for bug 178258 (HTML parser <script> handling)
 * intermittently (but quite rarely) missing 1 or 2 points (#26, #27) for
   bug 335998 (GC timing and nodes owning parents) 

Layout tests:
 * white X on purple and red background in upper right is due to lack
   of support for downloadable TTF fonts (bug 441473, etc.)

Smoothness:
  Currently too slow on #26, #40, and (on slower machines) #65.  (Maybe more of them on even slower machines.)
(In reply to comment #51)
> Smoothness:
>   Currently too slow on #26, #40, and (on slower machines) #65.  (Maybe more of
> them on even slower machines.)

Your machines must be slower than mine.  I only see an issue on #26 which is no where close to passing.
Test 26 passed, but took 140ms (less than 30fps)
...
Test 65 passed, but took 42ms (less than 30fps)

These are the only two slow tests for me. Total time: 0.47s.
Just to keep this information at hand...

Hixie writes: The "reference hardware" is whatever the top-of-the-line Apple laptop is at the time the test is run... http://ln.hixie.ch/?start=1207096078&count=1

N.b. Right now. Not from the time the test was released. Hixie also writes: "So for the record: if the test is run on a slow computer or device, it may run slowly or not smoothly and this does not imply non-conformance." http://ln.hixie.ch/?start=1208832405&count=1
Here, linux AMD Athlon(tm) 64 Processor 3500+
Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.9.1b1pre) Gecko/20080917020400 Minefield/3.1b1pre

Test 08 passed, but took 58ms (less than 30fps)
Test 26 passed, but took 561ms (less than 30fps)
Test 33 passed, but took 51ms (less than 30fps)
Test 39 passed, but took 45ms (less than 30fps)
Test 40 passed, but took 54ms (less than 30fps)
Test 43 passed, but took 36ms (less than 30fps)
Test 46 passed, but took 66ms (less than 30fps)
Test 65 passed, but took 65ms (less than 30fps)
I don't think comparing numbers helps a lot to fix the issues.
What I would like to know is whether TraceMonkey helps this issues. Unfortunately I can't test since building TM is disabled on x86_64.
Last I checked (a few months ago, I think, and I only looked briefly at profiles), the performance issues on tests #26 and #40 are mostly in things like XPConnect (code that acts as the glue between JavaScript and the DOM) and maybe CAPS (code that does security checks).  I can reprofile at some point, unless somebody beats me to it.  I think tracemonkey is unlikely to help there, but I think there may be other ongoing performance work that is likely to help.

And yes, posting further performance numbers to this bug probably isn't helpful, especially given comment 54.  If there are other performance problems that you think merit analysis, you're always welcome to file separate bugs on them.
Various corrections and updates to my previous status report:

Numeric tests:
 * trunk now at 87/100
   + bug 450160 landed
 * patches currently in bug 302775, bug 433533, bug 174351, bug 454325, bug 178258, and bug 216462 (with --enable-smil or equivalent modification of patch) get us to 97/100
 * missing 3 points (#77, #78, #79) for SVG fonts and other related SVG
   issues (some might be easy; these need to be analyzed)
 * intermittently (but quite rarely) missing 1 or 2 points (#26, #27) for
   bug 335998 (GC timing and nodes owning parents) 

Layout tests:
 * white X on purple and red background in upper right is due to lack
   of support for downloadable TTF fonts (bug 441473, etc.; I think the
   current patch fixes this on Windows and Mac OS X only)

Smoothness:
  Currently too slow on #26 and perhaps others (although probably not, per comment 54)

Favicon:
  favicon.ico is displayed as the favicon, despite being a PNG file  (At least, I think that's why Hixie's saying it shouldn't show up... not that there's any spec for favicon.ico.)
Actually, the reason why favicon.ico should not show up is because visiting
http://acid3.acidtests.org/favicon.ico
gives a 404 Not Found server response, with a response body of the red cat image. Supposedly, this means that the favicon should not be shown.
No longer depends on: 443648
So I looked into test 77, test 78, and test 79 a bit further:

Test 77 tests SVG fonts by providing a font with odd metrics and then checking that those metrics were used with various methods.  We fail this since we don't support SVG fonts (bug 119490).  However, while looking at the numbers we were returning (given that we don't process the font), I also noticed bug 456282, which would also need to be fixed to pass this test.

Test 78 appears to be failing only because of lack of support for SVG fonts.  It gets the rotation of characters along a path that is designed to perfectly fit the oddly-shaped font given.  The methods and markup that this test uses seem to work correctly in a separate test that I wrote.  (Though we do differ from Opera on that simple test; our getRotationOfChar throws if the character didn't fit on the path; theirs doesn't.  However, Acid3 doesn't test that case, and I haven't looked into what's correct.)

Test 79 is also testing SVG fonts.  However, the very first failure (length mismatch) is because we don't support the altGlyph element, so its contents don't count towards the text length.  I filed bug 456286 on whether we should treat altGlyph more like tspan, although that's really about fallback behavior for before we implement SVG fonts.  (That assumes that "implement SVG fonts" includes support for altGlyph, which it may or may not in the initial implementation.)  This test is complicated enough that I haven't analyzed it further.


I'll also note that bug 281150 covers the favicon; I added that as a dependency as well.
Depends on: 456317
No longer depends on: 456317
Depends on: 457429
Intermittently, I fail test 80 with -  kungFuDeathGrip was null.
(In reply to comment #61)
> Intermittently, I fail test 80 with -  kungFuDeathGrip was null.

Oops!  Sorry for SPAM.  I see now that this was already covered in comment #32 and comment #33.
Depends on: 450191
after first open page  http://acid3.acidtests.org/
88/100
Failed 12 tests.
Test 07 failed: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIDOMRange.cloneContents]
Test 09 failed: expected 'Hello Wonderful KittyHow are you?' but got '' - toString() on range selecting Document gave wrong output
Test 10 failed: expected 'result' but got '' - toString() didn't work for attribute node
Test 11 failed: when inserting <a> into Document with another child: wrong exception raised
Test 26 passed, but took 152ms (less than 30fps)
Test 70 failed: UTF-8 encoded XML document with invalid character did not have a well-formedness error
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Test 80 failed: kungFuDeathGrip was null
Total elapsed time: 0.80s

after refresh (dont close/open page)
89/100
Failed 11 tests.
Test 07 failed: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIDOMRange.cloneContents]
Test 09 failed: expected 'Hello Wonderful KittyHow are you?' but got '' - toString() on range selecting Document gave wrong output
Test 10 failed: expected 'result' but got '' - toString() didn't work for attribute node
Test 11 failed: when inserting <a> into Document with another child: wrong exception raised
Test 26 passed, but took 145ms (less than 30fps)
Test 69 passed, but took 2 attempts (less than perfect).
Test 70 failed: UTF-8 encoded XML document with invalid character did not have a well-formedness error
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 6.27s

wats wrong?
sorry, version browser
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1b1pre) Gecko/20081001 Minefield/3.1b1pre
Depends on: 458104
Depends on: 458169
Current status:

Points:
* trunk now at 93/100 most of the time
* intermittently (but quite rarely) failing some tests (#26, #27, #80) for bug 335998 (GC timing and nodes owning parents)
* patch currently in bug 174351 fixes test 70
* patch currently in bug 178258 fixes test 71
* patch currently in bug 216462 (with --enable-smil or equivalent modification of patch) fixes test 75 and test 76
* test 77, test 78, and 79 are failing due to lack of SVG fonts; see comment 60 for more details

Layout tests:
* white X on purple and red background in upper right is still present on Linux due to lack of support for downloadable TTF fonts (bug 458169) -- and probably also on any other non-Windows non-Mac ports

Smoothness:
Currently too slow on #26 by about a factor of 4. This is an explicit performance test of DOM. We're currently spending about 30% of the time in JS+XPConnect (JS, quick stubs) and about 70% in content+layout (content and frame creation, style resolution) 

Favicon:
favicon.ico is displayed as the favicon, despite being a 404 response (bug 281150)
FWIW, having Adblock Plus 0.7.5.5 enabled makes 72 and 74 fail here as well, but 70 pass.
72: doc.images is undefined
74: contentDocument failed for <object> referencing an svg document
Add acid site to white list in Adblock plus :)
At least one of them is due to "show tabs on flash and java" feature (http://adblockplus.org/en/faq_features#objecttabs). Feel free to disable it while running the test ;)
OK, with "show tabs on flash and java" disabled, eveything is back to normal,
i.e. 70 fails and 72 and 74 pass (click on the letter "A" to display a report).
Depends on: 460487
Looks like we lost a point on the test in the latest hourly builds: 

Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1b2pre) Gecko/20081102 Minefield/3.1b2pre

Test 46 case r - anyone want to guess if its a problem with the test or that something has regressed here?
Test 46 is the one the WG asked Hixie to change in Acid3, see
https://bugzilla.mozilla.org/show_bug.cgi?id=454226#c7
(In reply to comment #66)
> Current status:
> 
> Points:
> * trunk now at 93/100 most of the time
> * intermittently (but quite rarely) failing some tests (#26, #27, #80) for bug
> 335998 (GC timing and nodes owning parents)

I still get intermittent failures on test 80 even with the patch currently attached to bug 335998 applied.
Flags: blocking1.9.2?
No longer depends on: 434269
Any updates on this?
Please do not spam. We will make a comment when there are updates.
(In reply to comment #75)
> Please do not spam. We will make a comment when there are updates.

Seriously? How is me asking for any updates 'spamming'?
You noticed the huge list of emails shows when you make a comment? That's spamming.

Also, as all news around acid 3 compatibility is posted in this bug, or one of it's dependencies, no new comments probably mean no updates.

If you want to get updated on acid 3 compatibility, put yourself on the CC list of this bug.

If you want firefox to become acid 3 compatibility, vote for this bug.

If you want to know what the current status is, either download a nightly build, and try it out, or ask in some firefox forums for a update, mozillazine is probably a good place, and there are plenty of topics about acid 3 there already.

Also, somebody is now probably going to point to the etiquette https://bugzilla.mozilla.org/page.cgi?id=etiquette.html
Depends on: 473705
Got the following tests failed 

Failed 7 tests.
Test 26 passed, but took 1065ms (less than 30fps)
Test 39 passed, but took 54ms (less than 30fps)
Test 40 passed, but took 94ms (less than 30fps)
Test 46 passed, but took 49ms (less than 30fps)
Test 70 failed: UTF-8 encoded XML document with invalid character did not have a well-formedness error
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 2.81s

This is on latest nightly Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2a1pre) Gecko/20090210 Minefield/3.2a1pre
Failed 6 tests.
Test 26 passed, but took 134ms (less than 30fps)
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 2.12s

On the latest 3.2 nightly (Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2a1pre) Gecko/20090217 Minefield/3.2a1pre)
No longer depends on: 281150
Depends on: 281150
Personnaly, I didn't managed to reach 94% with the nightly build 20090226035935.
I reach 93%, or 92% (yes, it doesn't always score the same).

Moreover, it always freeze on the 26% or 27% step ... taking always at least 5 seconds to complete (where other users complete in 3 seconds).
(5 seconds on a 3GHz Pentium IV with 1Gb of RAM)

However, I managed to reach (2 times on 20 tests) the 94% with the build of   Ted Mielczarek (:luser)  of 2009-02-27 04:31:33 PST :
http://mavra.perilith.com/~luser/latest-teds-builds/firefox-3.2a1pre.en-US.win32.zip
But his changes are related to the bug 475178 and bug 480303, not to Acid 3 tests.


Here is my 93% dialog box with the nightly build 20090226035935 :
Failed 7 tests.
Test 26 passed, but took 4682ms (less than 30fps)
Test 65 passed, but took 56ms (less than 30fps)
Test 71 failed: doc.open is not a function
Test 72 failed: doc.images is undefined
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 5.46s
the build which allowed me to reach 94% has been backed up at :
http://mavra.perilith.com/~luser/latest-teds-builds/firefox-3.2a1pre.en-US.win32.bug475178.zip
Depends on: enablesmil
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2a1pre) Gecko/20090311 Minefield/3.2a1pre
7 year old 2.2GHz P4 with 1.5Gb of RAM

96/100 with svg.smil.enabled set to true in about:config on a fresh profile.

Failed 4 tests.
Test 26 passed, but took 868ms (less than 30fps)
Test 40 passed, but took 38ms (less than 30fps)
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 3.23s
The pink square shows up again in the right upper corner on "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1b5pre) Gecko/20090510 Shiretoko/3.5b5pre" (see: http://img.mpopp.net/acid3-shiretoko.png)
Mozilla/5.0 (X11; U; Linux x86_64; ru; rv:1.9.2a1pre) Gecko/20090514 Minefield/3.6a1pre
Still 96/100
And the same as described above... (still, the results for the test 26 and 40 are better than before )) )
Failed 4 tests.
Test 26 passed, but took 521ms (less than 30fps)
Test 40 passed, but took 35ms (less than 30fps)
Test 65 passed, but took 47ms (less than 30fps)
Test 69 passed, but took 40 attempts (less than perfect).
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 77 failed: expected '4776' but got '7180' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 2.92s
Sorry to spam, but I only got 94/100 instead 96/100 :

Failed 6 tests.
Test 26 passed, but took 434ms (less than 30fps)
Test 40 passed, but took 36ms (less than 30fps)
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '7180' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 2.32s

What makes test 75 an 76 not working ?
(In reply to comment #86)
> Sorry to spam, but I only got 94/100 instead 96/100 :
[...]
> What makes test 75 an 76 not working ?

Apparently your Firefox version: note that you should have posted it for completeness, specially when questioning something like this -- you may simply copy+paste the text contents of menu "Help", option "About Mozilla Firefox", after the copyright text (something like [1]). ;-)

SMIL animation (in SVG), the feature exercised in those tests, is not yet available in any released version (currently it's in 3.6a, which can be tried out using a nightly build [2] or compiling the code yourself). Note that, even in those versions, the feature is currently off by default (see bug 482402) so, as somehow stated in comment 82, one must go to "about:config" (in the address bar) and set "svg.smil.enabled" to "true" (naturally, all of these without quotes). :-)

[1] Mozilla/5.0 (Windows; U; Windows NT 6.0; pt-PT; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
[2] http://www.mozilla.org/developer/#builds
Well. Something reset the flag for smil. And I'm using homemade trunk builds.

Weird :)

/me is sorry for not having checked the flag before :/
Is test 70 really passed? For me it isn't (my own cairo-gtk2 compilation of fx-3.5rc2). I get this error:

"Test 70 failed: UTF-8 encoded XML document with invalid character did not have a well-formedness error"
P.S. Of course I tested it in the safe mode. Still 93/100.
I got 94/100 with Test 70 passed. It passed in safe mode too.

Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.2a1pre) Gecko/20090620 Minefield/3.6a1pre (.NET CLR 3.5.30729) ID:20090620042612
(In reply to comment #89)
> Is test 70 really passed? For me it isn't (my own cairo-gtk2 compilation of
> fx-3.5rc2). I get this error:

I was fixed it on trunk only, not 1.9.1 tree.  Bug 174351 has no "fixed1.9.1" keyword.
Depends on: 501345
The favicon of the acid 3 test page shouldn't appear (It should display a generic web page icon)
But it does appear with Firefox 3.5 final.

Read here:
http://en.wikipedia.org/wiki/Acid3#The_test
That's bug 281150, already on this bug's dependency list :)
Just ran the test in Minefield build 20090721044139 and scored a 91/100 Also .gif images decided to die in this build.
I got 94/100 on Gecko/20090721 Minefield/3.6a1pre.

.gif image problems are bug 505473 and unrelated to acid 3 (I think).
I figured they were unrelated, come to think of it I only mentioned it because it's tied to the build. I'll try running the test in safe mode one of my extensions might be interfering.
My Firefox 3.5.1 achieved 92 on the Acid3 Test.  Just upgraded to 3.5.2 and score went down to 91.  Anybody have an explanation as to why?
I get 93 with 3.5.2

Test 71 failed: doc.open is not a function
Test 72 failed: doc.images is undefined
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect

Could you please tell us which are the other two (shift + click on the big A to get the results in a new window to able to copy it)
Failed 8 of 100 tests.
Test 26 passed, but took 269ms (less than 30fps)
Test 71 failed: doc.open is not a function
Test 72 failed: doc.images is undefined
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Test 80 failed: kungFuDeathGrip was null
Total elapsed time: 1.97s
It varies from person-to-person. Here are my results in 3.5.2. I always struggle on test 69. On my old Windows XP computer, it was extremely slow and failed that test. In my new Windows Vista, it passes it, but only just.

Failed 8 tests.
Test 26 passed, but took 146ms (less than 30fps)
Test 69 passed, but took 1 attempts (less than perfect).
Test 70 failed: UTF-8 encoded XML document with invalid character did not have a well-formedness error
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Test 80 failed: kungFuDeathGrip was null
Total elapsed time: 0.82s
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2a1pre) Gecko/20090805 Ubuntu/9.10 (Karmic Koala) Firefox/3.6a1pre - Build ID: 20090805165522

Failed 9 of 100 tests.
Test 26 passed, but took 258ms (less than 30fps)
Test 39 passed, but took 47ms (less than 30fps)
Test 40 passed, but took 43ms (less than 30fps)
Test 71 failed: missing document for test
Test 72 failed: missing document for test
Test 73 failed: doc is undefined
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '7180' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Test 80 failed: linktest link couldn't be found
Total elapsed time: 1.68s
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.3a1pre) Gecko/20090814 Minefield/3.7a1pre (rev 6920d39fa27c)

With default settings:
Failed 6 of 100 tests.
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '7180' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect

With html5.enable and svg.smil.enabled set to true:
Failed 3 of 100 tests.
Test 77 failed: expected '4776' but got '7180' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Flags: wanted1.9.2?
Flags: wanted1.9.2?
Flags: wanted1.9.2-
Flags: wanted1.9.1?
Flags: blocking1.9.2?
Flags: blocking1.9.2-
9 Tests failed 

Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2b1pre) Gecko/20090924 Namoroka/3.6b1pre


Failed 9 tests.
Test 16 passed, but took 39ms (less than 30fps)
Test 26 passed, but took 1026ms (less than 30fps)
Test 39 passed, but took 53ms (less than 30fps)
Test 40 passed, but took 78ms (less than 30fps)
Test 43 passed, but took 36ms (less than 30fps)
Test 46 passed, but took 47ms (less than 30fps)
Test 65 passed, but took 145ms (less than 30fps)
Test 69 passed, but took 415 attempts (less than perfect).
Test 71 failed: missing document for test
Test 72 failed: missing document for test
Test 73 failed: doc is undefined
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Test 80 failed: linktest link couldn't be found
Total elapsed time: 15.66s
ah, oops. It seemed I made some changes underneath hence it didn't come correctly. I made a new profile and ran the tests again, this time it showed 94% pass. 

Failed 6 tests.
Test 26 passed, but took 899ms (less than 30fps)
Test 39 passed, but took 43ms (less than 30fps)
Test 40 passed, but took 86ms (less than 30fps)
Test 46 passed, but took 42ms (less than 30fps)
Test 69 passed, but took 117 attempts (less than perfect).
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 75 failed: anim.beginElement is not a function
Test 76 failed: expected '0' but got '100' - Incorrect animVal value after svg animation.
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 7.37s

I could send my prefs.js file off-line to somebody if someone is willing to take a look at it and tell me where or what I changed which failed so many tests more so can fix that. 

Also do not have any idea if prefs.js does have some intimate information (like passwords and such) which shouldn't be but its still good to be on safer side. Sorry for the earlier plug :)
To me, it appears to be random whether it passes 92-94 tests, just reloading might change the result, but 94 is the current maximum with Firefox 3.6 and the original settings.
Depends on: lazyfc
Bug 482402 -  (smil) Enable "svg.smil.enabled" pref by default. Landed  +2 points in Acid 3 test. Score: 96/100.

Failed 4 of 100 tests.
Test 26 passed, but took 574ms (less than 30fps)
Test 40 passed, but took 41ms (less than 30fps)
Test 71 failed: expected '1' but got '2' - wrong number of children in HEAD (first test)
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 3.17s.

Original settings.
Failed 3 tests.
Test 26 passed, but took 162ms (less than 30fps)
Test 69 passed, but took 150 attempts (less than perfect).
Test 71 passed, but took 113ms (less than 30fps)
Test 77 failed: expected '4776' but got '6720' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: expected '34' but got '33' - SVGSVGTextElement.getNumberOfChars() incorrect
Total elapsed time: 5.69s

hg_c5b353307fb8
Mozilla/5.0 (X11; U; Linux x86_64; ja; rv:1.9.3a1pre) Gecko/20091023  Minefield/3.7a1pre
Mine report is for 3.6 and original settings. Yours for 3.7 and html5.enable set to true. This pref is not original settings.
Can we please stop getting spammed by endless testers eagerly posting their
latest (apparently insignificant) results? If I'm CC'd on this bug, I already
get bug fix/break notifications for all the bugs that block this -- that's the
point of a meta bug, after all. I don't need to hear *again* that a particular
test has been passed -- I've probably already read the bug that fixed it, and
if not, chances are I don't care all that much. And I really don't need to hear
about how many fps your installation can run.

Maybe others care about all these redundant test runs, but I'm rather tired of
them. (And sincere apologies to all 200+ of you who got slammed with *yet
another* spam.)

Most of the time, if you have an interesting and unexpected test pass or
failure, just *find the right bug* in the dependencies and post there!
Encouragement post:

Only 5 bugs remaining. Come on, guys! Let's get this done!
Failed 3 of 100 tests.
Test 26 passed, but took 64ms (less than 30fps)
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: character position 1, which is between a normal character and the first character of a two-character glyph, is 72 but should be 10000.
Total elapsed time: 0.11s

Mozilla/5.0 (Windows; U; Windows NT 6.1; WOW64; en-US; rv:1.9.3a5pre) Gecko/20100608 Minefield/3.7a5pre

Looks like Test 79 has been worked on, but it still isn't quite there yet.

Tests 69 and 80 are sometimes "less than perfect", but that seems to be cleared up with caching the page.  It also occurs similarly in noncached tests run on other "perfect" browsers such as Chrome, Opera and Safari.
Firefox 4 beta 2 scores only 95/100 compared to firefox beta 1 97/100. What happened??
The latest nightly is still working fine (97/100).

Failed 3 tests.
Test 26 passed, but took 60ms (less than 30fps)
Test 69 passed, but took 64 attempts (less than perfect).
Test 77 failed: expected '4776' but got '5560' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: character position 1, which is between a normal character and the first character of a two-character glyph, is 72 but should be 10000.
Total elapsed time: 2.91s

Mozilla/5.0 (Windows; Windows NT 5.1; rv:2.0b3pre) Gecko/20100727 Minefield/4.0b3pre
HTML5, Modernized: Fourth IE9 Platform Preview Available for Developers
http://blogs.msdn.com/b/ie/archive/2010/08/04/html5-modernized-fourth-ie9-platform-preview-available-for-developers.aspx

Acid3 Score: 95/100

"As IE9 has implemented more of the standards that developers use and value, IE9’s Acid3 score has continued to rise. The remaining points involve two particular technologies (SVG Fonts and SMIL animation of SVG) that are in transition."
Latest nightly status:

Failed 3 tests.
Test 26 passed, but took 44ms (less than 30fps)
Test 77 failed: expected '4776' but got '5550.625' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: character position 1, which is between a normal character and the first character of a two-character glyph, is 72.21875 but should be 10000.
Total elapsed time: 0.65s

Mozilla/5.0 (Windows NT 6.1; WOW64; rv:2.0b7pre) Gecko/20100923 Firefox/4.0b7pre
Current hourly only scores 94/100 and takes awhile to get there...

Failed 6 tests.
Test 26 passed, but took 44ms (less than 30fps)
Test 69 failed: timeout -- could be a networking issue
Test 75 failed: Permission denied for <http://acid3.acidtests.org> to get property HTMLDocument.documentElement from <moz-safe-about:neterror?e=fileNotFound&u=http%3A//acid3.acidtests.org/svg.xml&c=UTF-8&d=Firefox%20can%27t%20find%20the%20file%20at%20http%3A//acid3.acidtests.org/svg.xml.>.
Test 76 failed: Permission denied for <http://acid3.acidtests.org> to get property HTMLDocument.getElementById from <moz-safe-about:neterror?e=fileNotFound&u=http%3A//acid3.acidtests.org/svg.xml&c=UTF-8&d=Firefox%20can%27t%20find%20the%20file%20at%20http%3A//acid3.acidtests.org/svg.xml.>.
Test 77 failed: Permission denied for <http://acid3.acidtests.org> to get property HTMLDocument.documentElement from <moz-safe-about:neterror?e=fileNotFound&u=http%3A//acid3.acidtests.org/svg.xml&c=UTF-8&d=Firefox%20can%27t%20find%20the%20file%20at%20http%3A//acid3.acidtests.org/svg.xml.>.
Test 78 failed: Permission denied for <http://acid3.acidtests.org> to get property HTMLDocument.documentElement from <moz-safe-about:neterror?e=fileNotFound&u=http%3A//acid3.acidtests.org/svg.xml&c=UTF-8&d=Firefox%20can%27t%20find%20the%20file%20at%20http%3A//acid3.acidtests.org/svg.xml.>.
Test 79 failed: character position 1, which is between a normal character and the first character of a two-character glyph, is 72.21875 but should be 10000.
Total elapsed time: 6.37s
(In reply to comment #118)
> Current hourly only scores 94/100 and takes awhile to get there...

Are you testing using a build from ftp.mozilla.org or a build that you made yourself?
(In reply to comment #118)
> Current hourly only scores 94/100 and takes awhile to get there...

Please run in a clean profile with no extensions(a few popular ones cause exactly what I see you getting) and give us your build id if it is really a regression.
(In reply to comment #120)
> (In reply to comment #118)
> > Current hourly only scores 94/100 and takes awhile to get there...
> 
> Please run in a clean profile with no extensions(a few popular ones cause
> exactly what I see you getting) and give us your build id if it is really a
> regression.

The only thing that changed since last time I ran it is my adblock subscriptions.. I disabled all extensions and still get 94/100.
(In reply to comment #121)
> > Please run in a clean profile with no extensions(a few popular ones cause
> > exactly what I see you getting) and give us your build id if it is really a
> > regression.
> 
> The only thing that changed since last time I ran it is my adblock
> subscriptions.. I disabled all extensions and still get 94/100.

Exactly, but you still have the extension there: I recall a somehow recent issue with Firebug which crashed Firefox even (when Firebug was) disabled. So please follow the comment 120 suggestion and create a brand new profile [1], don't install *any* extensions and then retry. ;-)

[1] http://kb.mozillazine.org/Profile_manager
Acid 3 test 97/100 FAILED (square - not blue!)

My Minefield:

about:buildconfig
Source

Built from http://hg.mozilla.org/mozilla-central/rev/2f456d0310fa
Build platform
target
i686-pc-mingw32
Build tools
Compiler 	Version 	Compiler flags
d;D:\mozilla-build\msys\mozilla-build\python25\python2.5.exe -O e;D:\mozilla-build\msys\builds\moz2_slave\mozilla-central-win32-nightly\build\build\cl.py cl 	14.00.50727.762 	-TC -nologo -W3 -Gy -Fdgenerated.pdb -DNDEBUG -DTRIMMED -Zi -Zi -UDEBUG -DNDEBUG -GL -wd4624 -wd4952 -O1
d;D:\mozilla-build\msys\mozilla-build\python25\python2.5.exe -O e;D:\mozilla-build\msys\builds\moz2_slave\mozilla-central-win32-nightly\build\build\cl.py cl 	14.00.50727.762 	-GR- -TP -nologo -Zc:wchar_t- -W3 -Gy -Fdgenerated.pdb -wd4800 -DNDEBUG -DTRIMMED -Zi -Zi -UDEBUG -DNDEBUG -GL -wd4624 -wd4952 -O1
Configure arguments

--enable-application=browser --enable-update-channel=nightly --enable-update-packaging --enable-jemalloc --enable-tests
Acid3 test 94/100 - something wrong? :)
(In reply to comment #124)
> Acid3 test 94/100 - something wrong? :)

Yes.,  This has been asked and answered numerous times in this bug already.  Please read ALL the comments before commenting.
(In reply to comment #68)
> Add acid site to white list in Adblock plus :)

The actual domain to whitelist in adblock and noscript is acidtests.org.
Current Minefield (1/11/11) reports a score of 97/100 with the following errors:

Failed 3 tests.
Test 26 passed, but took 64ms (less than 30fps)
Test 71 passed, but took 83ms (less than 30fps)
Test 77 failed: expected '4776' but got '5550.625' - getComputedTextLength failed.
Test 78 failed: expected '90' but got '0' - getRotationOfChar(0) failed.
Test 79 failed: character position 1, which is between a normal character and the first character of a two-character glyph, is 72.21875 but should be 10000.
Total elapsed time: 0.84s
(In reply to comment #127)
First see comment 111,

97/100 is the current status on acid3, and will most likely stay that way as there's a question for the need of svg font support (many of those failures comes from svg fonts see earlier comments from dbaron).
Whiteboard: read #111 BEFORE commenting
No longer depends on: 426027
Whiteboard: read #111 BEFORE commenting → read #111 #126 and #128 BEFORE commenting
http://limi.net/articles/firefox-acid3 for more details on why it will stay on 97/100 (and why that’s a good thing)

ps. read #111 #126 and #128 BEFORE commenting.
https://bugzilla.mozilla.org/show_bug.cgi?id=119490#c63

A good implementation of SVG is needed. A good SVG implementation would mean passing the Acid3 test, but that's a byproduct, a collateral benefit. A good SVG implementation is needed per se. 

This is a vicious circle: if browsers don't implement SVG fonts, developers won't use them. Developers won't use them because browsers don't implement them. The bug for SVG fonts was filed on 2002-01-11, 9 years ago, and its current status is ASSIGNED. 9 years and the bug is still there, and now the reasoning for not fixing it is that the feature is not used, it's probably going to have its specifications changed and because *now* WOFF is allegedly better. LOL. How could anyone have been using a feature that was not implemented? Of course a feature will likely be changed/deprecated after 9 years. And WOFF and SVG are not entirely interchangeable, i.e. It's nice to have WOFF, but SVG is still needed.

Does "Paste and Go" ring a bell? A bug was filed in 2002/3 requesting paste and go. It was left to rot into oblivion, dismissed by the developers, until Limi did a survey in Reddit last year and found out that people desperately wanted Paste and go (a really useful feature, by the way). Firefox 4 will finally implement Paste and Go. After 9 years. It would be nice if SVG fonts were also implemented. Gosh! You developers can be really stubborn!
No browser fully supports SVG but would be a nice addition like in comment 130.

How does WebKit pass tests 77, 78 and 79? Those seem to be the tests still failing and it would be nice to take a look at how WebKit implements SVG fonts.

With Paste & Go it would be a great time saver and I use it all the time in Chromium.

I don't mind the devs being stubborn because you never know what they're up to!
(In reply to comment #123)
> Acid 3 test 97/100 FAILED (square - not blue!)

What is the status of the 2nd from right square being grey instead of blue? Is it also because of the svg-#@& ?
The squares represent each set of tests and are colored instead of grey when that set is fully passed. It's just another progress indicator. So yes, the 3/100 tests that aren't passed are the reason the 2nd to last square isn't blue.

Each comment here emails hundreds of people, so please, no more comments needed.

Just to keep the link in the last comment:
http://limi.net/articles/firefox-acid3
It seems that there are more issues with some of the Acid3 tests - http://annevankesteren.nl/2011/09/acid3-problem - and that they started collecting list of proposed changes to Acid3 - http://annevankesteren.nl/2011/09/changing-acid3 .
Should we add our remaining 3 items on that list?
Acid3 has now changed and Firefox gets 100/100, as does the latest IE.

https://plus.google.com/107429617152575897589/posts/JdHnqpuUER4

The details

Failed 0 tests.
Test 26 passed, but took 247ms (less than 30fps)
Test 69 passed, but took 11 attempts (less than perfect).
Test 71 passed, but took 53ms (less than 30fps)
Total elapsed time: 3.48s

Thus Firefox still fails that weird "smoothness criterion" that tech journalists are 100 % clueless about. And since all browsers now get 100 points we can assume that the test will no longer be used in articles and blog posts.

Proposing we mark this bug as FIXED
I sure hope that it'll be marked as fixed, I've been trying to get out of the mailing list since eternity.. (I'm half-joking half-serious)
Fixed indeed, and lessons learned. Let us lay this test to rest now.
Status: NEW → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
What about an update of
https://spreadsheets.google.com/pub?key=pNgBCwWdyRTT2JeiZn4B2Yw ?

Is this document still of any relevance (last updated: build 20100220)?
What about an update of
https://spreadsheets.google.com/pub?key=pNgBCwWdyRTT2JeiZn4B2Yw ?

Is that document still of any relevance (last updated: build 20100220)?
What about an update of
https://spreadsheets.google.com/pub?key=pNgBCwWdyRTT2JeiZn4B2Yw ?

Is that document still of any relevance (last updated: build 20100220)?
@admin:

Sorry for the triple-post and spamming the bug list (caused by a browser hang). Please ignore and delete the first two, leaving the most recent one of them.
(In reply to Sierk Bornemann from comment #141)
Comments are rarely deleted/hidden and not for the above sort of thing. Don't worry about it.

(In reply to Sierk Bornemann from comment #140)
> What about an update of
> https://spreadsheets.google.com/pub?key=pNgBCwWdyRTT2JeiZn4B2Yw ?
> 
> Is that document still of any relevance (last updated: build 20100220)?

That appears to be out of date. Line #71 notes two pending bug numbers, both of which are now fixed. The page says up top it was last updated 20100220 (2010-02-20). I'd say it's obsolete.

(In reply to Lars Gunther from comment #135)
> Failed 0 tests.
> Test 26 passed, but took 247ms (less than 30fps)
> Test 69 passed, but took 11 attempts (less than perfect).
> Test 71 passed, but took 53ms (less than 30fps)
> Total elapsed time: 3.48s
> 
> Thus Firefox still fails that weird "smoothness criterion" that tech
> journalists are 100 % clueless about.

Your time is way slower than what many others get. My runs are always way under a second and I usually only get two warning lines, sometimes one, and I suspect others may get none on faster systems. Attempting to measure stuff like this here was always going to be a problem because it's not going to have the same results for every system, not to mention the vagueness of saying "the animation has to be smooth". For the record, here's the sort of output I get for a new Firefox 6.0.2 profile on Linux using my laptop:

Failed 0 of 100 tests.
Test 26 passed, but took 70ms (less than 30fps)
Test 69 passed, but took 1 attempts (less than perfect).
Total elapsed time: 0.29s

Minefield gets similar results.

As far as I'm concerned, all of the stated criteria are fulfilled in the new Acid3 version. This is completely done now; I'll even mark this bug verified. I guess we're just waiting on Acid4 now. ;)

To everyone considering commenting here: All new comments email hundreds of people and this bug is done, so no more posting here, please.
Status: RESOLVED → VERIFIED
No longer depends on: 119490
SVG fonts are an essential element of the architecture SVG. The reason is that XML structure allows to manipulate an SVG source consistently.
It seems to me that in Acid3test the test done on SVG fonts has been dishonestly removed: is that correct?
Again, this is not a discussion forum.
https://bugzilla.mozilla.org/page.cgi?id=etiquette.html
Awesome, it has finally passed it.
Should be reopened, Fennec 14 final fails with score 99.
Depends on: 754585
Depends on: 793890
Depends on: 976649
Product: Core → Core Graveyard
I believe I found a regression: test 72 is failing on Firefox 50 ("expected '10' but got '19' - prerequisite failed: style didn't affect image").
(In reply to Alexandre Folle de Menezes from comment #148)
> I believe I found a regression: test 72 is failing on Firefox 50 ("expected
> '10' but got '19' - prerequisite failed: style didn't affect image").

Are you testing with a new clean profile?, as the test conditions say you should?
I see 100/100 with Fx50 and a clean profile. On Nightly, the only failure I see is test 35, which is covered by bug 1311329. So yeah, I'd strongly suspect an addon interfering or something.
(In reply to Ryan VanderMeulen [:RyanVM] from comment #150)
> I see 100/100 with Fx50 and a clean profile. On Nightly, the only failure I
> see is test 35, which is covered by bug 1311329. So yeah, I'd strongly
> suspect an addon interfering or something.

I had the "Findbar Tweak" plugin/extension/add-on installed. Removing/uninstalling/disabling it makes Acid3 pass 100/100.
Depends on: 1311329
(In reply to Bill Gianopoulos [:WG9s] from comment #149)
> (In reply to Alexandre Folle de Menezes from comment #148)
> > I believe I found a regression: test 72 is failing on Firefox 50 ("expected
> > '10' but got '19' - prerequisite failed: style didn't affect image").
> 
> Are you testing with a new clean profile?, as the test conditions say you
> should?

Indeed, I get 100/100 of FFox 50 when I disable all add-ons.  Sorry for the noise.
Depends on: 1325080
You need to log in before you can comment on or make changes to this bug.