Last Comment Bug 802882 - (html5test) improve score on html5test.com
(html5test)
: improve score on html5test.com
Status: NEW
: meta
Product: Core
Classification: Components
Component: General (show other bugs)
: Trunk
: All All
: -- normal with 72 votes (vote)
: ---
Assigned To: Nobody; OK to take it and work on it
: chris hofmann
:
Mentors:
http://html5test.com/
Depends on: ruby html5-keygen 312971 CSP 547004 556743 harmony:modules webvtt 670898 675943 702870 723008 746087 748351 android-webrtc b2g-webrtc MSE 822898 dialog-element datetime webgl2 897102 1005268 streams framesandbox 344616 344618 446510 508725 559284 562008 591737 601912 629801 631218 643325 webrtc 676619 749459 760140 768067 webaudio 782211 799318 802895 825294 828974 830734 vp9 833385 856375 878828 884275 910138 966591 TTS_for_firefox ServiceWorkers-v1 1157724 1185106
Blocks: WBGP
  Show dependency treegraph
 
Reported: 2012-10-17 16:47 PDT by David Baron :dbaron: ⌚️UTC-8
Modified: 2017-01-05 00:56 PST (History)
86 users (show)
See Also:
Crash Signature:
(edit)
QA Whiteboard:
Iteration: ---
Points: ---
Has Regression Range: ---
Has STR: ---


Attachments
modernizr input tests in Firefox for Android 29 (106.02 KB, image/png)
2014-05-02 03:52 PDT, Merih Akar
no flags Details

Description User image David Baron :dbaron: ⌚️UTC-8 2012-10-17 16:47:21 PDT
This bug exists to track things we can do to improve our score on http://html5test.com/ , the source of which exists at https://github.com/NielsLeenheer/html5test/ .

While presence in this test doesn't necessarily change the priority of our work, it is interesting enough to track.
Comment 1 User image David Baron :dbaron: ⌚️UTC-8 2012-10-17 18:10:54 PDT
https://github.com/NielsLeenheer/html5test/pull/211
Comment 2 User image David Baron :dbaron: ⌚️UTC-8 2012-10-17 18:13:47 PDT
And the most useful view of this bug is probably:
https://bugzilla.mozilla.org/showdependencytree.cgi?id=802882&maxdepth=1
Comment 3 User image Fabio 2012-10-24 05:43:18 PDT
This should also depends on bug #344614.
Comment 4 User image David Baron :dbaron: ⌚️UTC-8 2012-10-24 05:50:27 PDT
(In reply to Fabio from comment #3)
> This should also depends on bug #344614.

I think it already has all the individual dependencies marked, so we don't also need to depend on the meta-bug for HTML5 forms (which depends on other things that aren't relevant to html5test.com).
Comment 5 User image Fabio 2012-10-24 06:07:28 PDT
(In reply to David Baron [:dbaron] from comment #4)
> (In reply to Fabio from comment #3)
> > This should also depends on bug #344614.
> 
> I think it already has all the individual dependencies marked, so we don't
> also need to depend on the meta-bug for HTML5 forms (which depends on other
> things that aren't relevant to html5test.com).

At least 446510 is still missing.
Comment 6 User image David Baron :dbaron: ⌚️UTC-8 2012-10-24 06:37:28 PDT
I had bug 773205 instead, but that indeed looks like a duplicate of bug 446510.
Comment 7 User image Markus Popp 2013-01-10 06:18:06 PST
Files bug #828974 which is related to this tracking bug.
Comment 8 User image Alexandre Folle de Menezes 2013-10-09 07:45:57 PDT
There's a new version coming (http://beta.html5test.com/) that adds many new tests like WebRTC and WebGL2.
Comment 9 User image Alexandre Folle de Menezes 2013-10-09 08:15:15 PDT
I don't know how to add dependencies with this new Bugzilla interface, these are the ones I found for the new version of the test:
Bug #493857 (Security/CSP)
Bug #600919 (2D/WebP)
Bug #750010 (P2P/WebRTC on Android)
Bug #778617 (Video/Media Source extensions)
Bug #833023 (Video/VP9 Support)
Bug #878828 (Input/Gamepad)
Bug #889977 (3D/WebGL 2)
Bug #910138 (2D/Ellipse)
Bug #923590 (Video/DRM Support (not!) )

I couldn't found bugs for Audio/Speech Recognition, Video/Codec Detection, 2D/Path, 2D/Dashed Line, 2D/Hit Testing, 2D/High Resolution, Security/Web and Cryptography API.
Comment 10 User image sjw 2013-10-09 08:22:40 PDT
You may not have the permissions to make these changes. You only can add dependencies while you create a new one.
May be it make sense to create a separated tracking bug for the new test?
Comment 11 User image José Jeria 2013-10-09 11:00:16 PDT
(In reply to sjw from comment #10)
> May be it make sense to create a separated tracking bug for the new test?

No real need for a new tracking but since beta.html5test.com will become html5test.com
Comment 12 User image Florian Bender 2013-10-11 09:25:55 PDT
2D/High resolution as currently tested is going away, so no bug needed here: http://lists.whatwg.org/htdig.cgi/whatwg-whatwg.org/2013-September/040735.html

Bug filed: https://github.com/NielsLeenheer/html5test/issues/286
Comment 13 User image Florian Bender 2013-10-11 10:24:25 PDT
The developer just confirmed [1] that DRM support does not change the score, so Bug 923590 (and related) should not be tracked by this bug. If this ever changes in the future, we can add it back. 

[1] https://github.com/NielsLeenheer/html5test/issues/287
Comment 14 User image Florian Bender 2013-10-11 11:32:56 PDT
Canvas Path is Bug 830734. Dashed support is Bug 768067 (and/or one of the bugs I mentioned in Bug 768067 Comment 7). 

I linked some discussions about the features here: https://github.com/NielsLeenheer/html5test/issues/287#issuecomment-26158091 – so there may be changes coming up. I voted for not counting these, too, which would make the bugs uninteresting for this bug.
Comment 15 User image Florian Bender 2013-10-11 12:29:16 PDT
(In reply to Alexandre Folle de Menezes from comment #9)
> I couldn't found bugs for […] Video/Codec Detection

That's Bug 884275. Please add as dependancy.


Enough bugspam for now, sorry!
Comment 16 User image Markus Popp 2013-10-19 10:29:49 PDT
Often at beta.html5test.com I get the Javascript message "Test has failed: Permission denied to access property 'encrypt'" and no score. Usually takes several page refreshs until everything works fine.

I observed this with versions 24.0 up to 27.0, all on Linux64 (though not necessarily limited to Linux64). This doesn't seem to occur with other browsers though, so I assume it's some imperfect feature implementation in Firefox, which I don't know.
Comment 17 User image Alexander Usyskin 2013-10-24 00:31:41 PDT
(In reply to Markus Popp from comment #16)
> Often at beta.html5test.com I get the Javascript message "Test has failed:
> Permission denied to access property 'encrypt'" and no score. Usually takes
> several page refreshs until everything works fine.
> 
> I observed this with versions 24.0 up to 27.0, all on Linux64 (though not
> necessarily limited to Linux64). This doesn't seem to occur with other
> browsers though, so I assume it's some imperfect feature implementation in
> Firefox, which I don't know.

It's filled as: https://bugzilla.mozilla.org/show_bug.cgi?id=927901
Comment 18 User image Florian Bender 2013-10-31 01:16:58 PDT
Per https://github.com/NielsLeenheer/html5test/issues/297, moar dependancies (this is not yet visible on the test page).
Comment 19 User image Chris Peterson [:cpeterson] 2013-11-05 18:00:03 PST
Tom's Hardware Guide's "Web Browser Grand Prix" (tracking bug 933949) includes html5test.
Comment 23 User image Tiago 2014-02-02 14:27:50 PST
How about #693083 and #966591?
Comment 24 User image Florian Bender 2014-02-03 03:23:38 PST
Bug 693083 / CSS Selectors Lvl 4 is not tested by HTML5Test.
Comment 25 User image Christian Stadler 2014-04-22 14:34:25 PDT
I've set up Win 8.1 x64 Enterprise Eval as a VM with VMWare and installer Firefox Aurora and later Firefox Beta to see, how the results on html5test.com will improve in a future version.
However: The result is actually 447 points in both, which is 1 point less, than the current release version. Can anybody tell me, what went wrong?

UA: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:29.0) Gecko/20100101 Firefox/29.0
Comment 26 User image Chris Peterson [:cpeterson] 2014-04-22 15:15:01 PDT
Christian: the html5test results page shows a break down of the individual features, so you should be able find the regression by comparing the subsections' points.

On OS X, however, I don't see a regression:

* Firefox 28 = 448
* Firefox Beta 29 = 467
* Firefox Aurora 30 = 467
* Firefox Nightly 31 = 475
* Chrome 34 = 505
Comment 27 User image Markus Popp 2014-04-22 16:41:08 PDT
(In reply to Chris Peterson (:cpeterson) from comment #26)
> * Firefox Nightly 31 = 475
> * Chrome 34 = 505

Are there plans to implement the missing form input types, especially the date/time types, any time soon? That should lift Firefox's score up to about where Chrome is now.
Comment 28 User image Sebastian Zartner [:sebo] 2014-04-23 02:04:07 PDT
(In reply to Christian Stadler from comment #25)
> I've set up Win 8.1 x64 Enterprise Eval as a VM with VMWare and installer
> Firefox Aurora and later Firefox Beta to see, how the results on
> html5test.com will improve in a future version.
> However: The result is actually 447 points in both, which is 1 point less,
> than the current release version. Can anybody tell me, what went wrong?

Are you sure you have the latest versions installed? My results on Win7 (32-bit):

Firefox 28 = 444
Firefox Beta 29 = 463
Firefox Aurora 30 (2014-04-22) = 463
Firefox Nightly 31 (2014-04-22) = 475

(In reply to Markus Popp from comment #27)
> (In reply to Chris Peterson (:cpeterson) from comment #26)
> > * Firefox Nightly 31 = 475
> > * Chrome 34 = 505
> 
> Are there plans to implement the missing form input types, especially the
> date/time types, any time soon? That should lift Firefox's score up to about
> where Chrome is now.

You may want to follow bug 888320 and related ones. Though from having a look at their history it doesn't seem there was big progress on them lately.

Sebastian
Comment 29 User image Christian Stadler 2014-04-23 04:30:25 PDT
(In reply to Chris Peterson (:cpeterson) from comment #26)
> Christian: the html5test results page shows a break down of the individual
> features, so you should be able find the regression by comparing the
> subsections' points.
> 
> On OS X, however, I don't see a regression:
> 
> * Firefox 28 = 448
> * Firefox Beta 29 = 467
> * Firefox Aurora 30 = 467
> * Firefox Nightly 31 = 475
> * Chrome 34 = 505

The problem was, that firefox seems to blacklist the VMWare video driver by default.
Setting webgl.force-enabled to true in about:config fixed the issue with WebGL being disabled. Now I've got 467 points on Beta 29 and Aurora 30

See also: https://support.mozilla.org/de/questions/865633
Comment 30 User image Merih Akar 2014-04-30 11:42:01 PDT
html5test on Firefox for Android says input type=[month, week, datetime] are not supported even if they are supported. Is this an issue on their testing method, or anything missing on the Firefox for Android side?
Comment 31 User image Florian Bender 2014-05-01 02:19:50 PDT
(In reply to merihakar from comment #30)
> html5test on Firefox for Android says input type=[month, week, datetime] are
> not supported even if they are supported. Is this an issue on their testing
> method, or anything missing on the Firefox for Android side?

This should pass on Android. Which version were you testing with? Can you test again with a currently Nightly, please?
Comment 32 User image Markus Popp 2014-05-01 08:30:37 PDT
(In reply to Florian Bender from comment #31)
> (In reply to merihakar from comment #30)
> > html5test on Firefox for Android says input type=[month, week, datetime] are
> > not supported even if they are supported. Is this an issue on their testing
> > method, or anything missing on the Firefox for Android side?
> 
> This should pass on Android. Which version were you testing with? Can you
> test again with a currently Nightly, please?

It's the same in today's Nightly, see http://img.mpopp.net/fx32html5test.png
Comment 33 User image Florian Bender 2014-05-02 03:31:31 PDT
What's your result on http://modernizr.github.io/Modernizr/test/index.html, inputtypes section?
Comment 34 User image Florian Bender 2014-05-02 03:37:36 PDT
Oh, and what inputs don't work here: https://miketaylr.com/pres/html5/forms2.html
Comment 35 User image Merih Akar 2014-05-02 03:52:53 PDT
Created attachment 8416420 [details]
modernizr input tests in Firefox for Android 29

On modernizr test page only date and time input types passes the test (see screenshot).

All date/time inputs work properly on https://miketaylr.com/pres/html5/forms2.html
Comment 36 User image Florian Bender 2014-05-02 06:59:51 PDT
Please file a bug then so we can investigate this further: How do the tests determine support, and why do they fail on Android? I don't have an Android device so I can't really help there. Thanks.
Comment 37 User image Markus Popp 2014-05-02 11:39:50 PDT
Look at the code sample, this is extracted from how html5test.com verifies support for input elements (month in this example):

http://jsfiddle.net/mpopp75/YWwC6/

For some reason, on Firefox Android the element.field.type value is not month (as in this example) as one would expect.
Comment 38 User image Markus Popp 2014-05-02 12:18:56 PDT
Filed bug #1005268

Note You need to log in before you can comment on or make changes to this bug.