Closed Bug 336164 Opened 14 years ago Closed 11 years ago

Implement WHATWG Audio spec


(Core :: Audio/Video, enhancement)

Not set





(Reporter: vlad, Unassigned)





(1 file)

We should implement the WHATWG audio spec, or at least some future incarnation of it (see for some more comments, also bug 92110).

Filing this in Widget as the closest-fit, since it will need some platform-specific audio playing infrastructure (with more control than nsISound).
Version: 1.8 Branch → Trunk
Blocks: 92110
Is Mozilla the only browser that doesn't support sound in SVG?
Now that Opera, Safari-webkit and IE with ASV all support sound.
see bug:
(In reply to comment #1)
> Is Mozilla the only browser that doesn't support sound in SVG?
> Now that Opera, Safari-webkit and IE with ASV all support sound.
> see bug:

The example given in that bug has nothing to do with SVG; it simply adds an XHTML embed element pointing to a sound file on mouseover.  Under Windows, that sound plays in Firefox, however, as with all other <embed> sounds, there's no control over it.

I hope we'll get around to implementing the WHATWG audio spec as soon as the remaining issues are resolved with it (I also hope that we never implement any sVG-specific sound/audio elements).

If you had opened the attachement provided in bug #334920 you would see it uses the WHATWG Audio spec, which currently works in Opera9b.

I have attached the same file to this bug.
Attached image HTML 5 Audio - Opera9b
Vladimir wrote,

"Under Windows, that sound plays in Firefox,"  it doesn't work for me:

Using the <embed> file:
with FF1.5.0.3 in Windows'98

 perhaps you could specify your version of windows?

should this perhaps be moved to another bug? this was my purpose in setting up the SVG audio bug, but perhaps the issue is more general? should that bug be reopened in respect of the fact that sound support through embed is evidently patchy?

I have started a page on the wiki with some notes on what libraries could be used for this. Feel free to complete or add comments.
In regards to that wiki page, I updated the license information as GStreamer and OpenAL where mistakenly listed as GPL. I would also say that it is probably a big mistake to try to split audio and video as separate unrelated tasks. The lets first do audio and then add in video later strategy is something many have burned themselves on before. Audio and video sync issues tend to be the most common issue with such an approach.
Thanks for your corrections and advices. I think whether to use GStreamer or not is a very important question to answer before going further on this.

I'm no licence expert, but LGPL code is already used indirectly as in the Gtk example. Would it be possible to ship GStreamer as a shared library as part of the installer? Of course, if other options are possible that would be great.

Do you have some experience with gstreamer on Win32 and OSX? I saw the songbird's people are using vlc on these OS'es, I was wondering what were the reasons about it (I didn't ask yet).
I would *love* to be able to use OpenAL, simply because that's what I'm most familiar with, having implemented theora and vorbis players using it before.

There was a discussion on about audio libraries recently:

There was also a discussion in the video session at the 'all hands' meeting. The consensus at the time was portaudio seemed to be the likely best option due to their license, it being fairly active, and it already being integrated on the zap branch.

I'm working on audio for the <video/> element and portaudio was the path I was intending to take based on that feedback.
Severity: normal → enhancement
Hardware: PC → All
I have not personally had any experience, but the Songbird guys seems happy so far. There are some further developments in that regard making GStreamer even better suited for cross-platform use, but I don't want to announce it before the Songbird guys do so.

I can't help but feel that the use of portaudio comes from a situation where you 
are not aware of the true difficulty of getting the media handling correct will be. Not having the usecase of audio and video sync as the top priority will land you with a **** solution on the level of the flash video player, where audio and video er more out of sync than in sync. Everytime I see something on youtube I wonder how they managed to produce something that bad.
Duplicate of this bug: 336742
Since its public know I thought I should mention that not only have Songbird announced that they will be using GStreamer across all platforms now, the GStreamer plugins developed on their behest is also out. Those plugins provide support for outputting audio and video on Windows and MacOSX and they also provide access to native codecs on both platforms.
Bug 382267, the implementation of <video>, has been refactored to allow <audio> to share code with it. It includes the start of an <audio> implementation.
Depends on: video
Assignee: general → nobody
Component: Widget → Video/Audio
QA Contact:
Component: Video/Audio → Widget
Component: Widget → Video/Audio
Depends on: 451004
This is implemented.
Closed: 11 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.