334920 - SVG foreignObject <object> broken

Status: RESOLVED FIXED

(Core :: SVG, defect)

Description

[jonathan chetwynd]

User-Agent:       Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.0.2) Gecko/20060313 Camino/1.0.0+
Build Identifier: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.0.2) Gecko/20060313 Camino/1.0.0+

sound is recognised by the senses in humans and animals.
sound is supported by most common user agents and devices.

Reproducible: Always




Please refer to bug https://bugzilla.mozilla.org/show_bug.cgi?id=92110
Allow simple audio format (wav, aiff) sound files to be played internally

it is important that SVG is included in this upgrade

Accessibility considerations indicate that there are significant advantages in providing sound for a very broad group of individuals. 

Many html sites, most games, flash and asv already do.

SVG 1.1 does not include sound, however given that adobe has purchased macromedia, it is only reasonable to query the rationale for this decision.

presumably some smaller devices do not include sound support this is unlikely to include mobiles.

Comment 1

[tor]

Audio is not in SVG 1.1.

Comment 2

[jonathan chetwynd]

is it the current process that enhancements are resolved as invalid?

this might seem to directly conflict with the meaning of enhancement...

Comment 3

[Aaron Lawrence]

You need to go an talk to the guys making the SVG standard. Mozilla doesn't arbitrarily extend standards.

Comment 4

[jonathan chetwynd]

A working example of sound playing in SVG using Safari Webkit is here:

http://bugzilla.opendarwin.org/attachment.cgi?id=8239

There are two graphics and each produces a unique sound onmouseover

this workaround relies on foreignObject

Comment 5

[jonathan chetwynd]

Attachment: HTML 5 Audio - Opera9b

Is Mozilla the only browser not to support sound?

Comment 6

[jonathan chetwynd]

Now that Opera, Safari-webkit and IE-ASV all support sound, is Mozilla the only browser that doesn't support sound?

Comment 7

[Hixie (not reading bugmail)]

(In reply to comment #4)
> A working example of sound playing in SVG using Safari Webkit is here:
> http://bugzilla.opendarwin.org/attachment.cgi?id=8239

This is just using <embed>, it has nothing to do with SVG. That should work in Mozilla already (assuming you have the relevant plugins involved). If it doesn't please file a bug on the plugin component.

Comment 8

[jonathan chetwynd]

(In reply to comment #7)
Hixie, 

embed works fine in HTML, the code in #4 relies on SVG element foreignObject which appears to be broken or disabled.
I have tested embed support in OS X and win'98 in each case the html embed file plays a sound but the SVG file does not.

One test for the html working is here: http://www.peepo.com

The attachment supplied uses WHATWG Audio

Comment 9

[jonathan chetwynd]

#7 Hixie,

what evidence is there that this is a plugin rather than foreignObject issue?

we know the plugin works #8, but not when used with foreignObject #4.

I wish to reopen this bug in the case that there is no other evidence.

cheers

Comment 10

[jonathan chetwynd]

Attachment: should play sound

Comment 11

[jonathan chetwynd]

copies Aaron in on bug, thanks to his offline comments have produced a very much smaller minimal testcase, which works for Safari Webkit

Comment 12

[jonathan chetwynd]

Attachment: flash embed/object example

Comment 13

[jonathan chetwynd]

Attachment: mp3 embed/object example

Comment 14

[jonathan chetwynd]

Changing bug summary to reflect widened scope of problem.

neither embed nor object appear to be supported when using foreignObject within SVG. see mp3 and flash attachments.

Comment 15

[jonathan chetwynd]

Attachment: java class: hello world

Comment 16

[jonathan chetwynd]

Attachment: java class: hello world

Comment 17

[jonathan chetwynd]

Attachment: java embed/object example

Comment 18

[jonathan chetwynd]

http://www.peepo.co.uk/temp/java.svg

this example demonstrates similar problem for java class embed/object
https://bugzilla.mozilla.org/show_bug.cgi?id=274217 was the original bug
attachments above don't work but this URI works in a fashion on Safari webkit.

Comment 19

[Jonathan Watt [:jwatt]]

foreignObject is working on trunk nightly builds so this should be fixed. Specifically if you have the plugin installed you should be able to hear https://bugzilla.mozilla.org/attachment.cgi?id=228821&action=view

Comment 20

[jonathan chetwynd]

#19

using OS X http://www.peepo.co.uk/temp/splat0.mp3 plays a sound

however the mp3 test case above which links to this file doesn't play the sound.

Comment 21

[jonathan chetwynd]

Attachment: html object mp3 test

demonstrates that sound works in embed html

Comment 22

[Frank Wein [:mcsmurf]]

This is wfm with a five day old nightly on Win2k and Quicktime as plugin.

Comment 23

[Dave Townsend [:mossop]]

I get no sound and I have quicktime and the html test works.

Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9a1) Gecko/20060811 Minefield/3.0a1 ID:2006081111

Comment 24

[Jonathan Watt [:jwatt]]

comment 22 was regarding the foreignObject mp3 test attachment 228821 [details], so it seems to work under certain circumstances, but not others

Comment 25

[jonathan chetwynd]

re #22

have asked frank to confirm what works for him,

it's not clear this isn't the html test :-)

cheers

Comment 26

[mozilla]

I hear a **** in Minefield version 3.0a1, Gecko/200608081, but i don't hear it in Firefox 1.5.0.6. Both on WinXP

Comment 27

[Jonathan Watt [:jwatt]]

firefox 1.5.x isn't expected to work

Comment 28

[jonathan chetwynd]

with a couple more win 2k or XP reports on:

http://www.peepo.co.uk/temp/java.svg

and

https://bugzilla.mozilla.org/attachment.cgi?id=228813

this could resolve to an OS X issue

cheers

firefox 1.5.x isn't expected to work

Comment 29

[mozilla]

Build identifier: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9a1) Gecko/2006081204 Minefield/3.0a1 on WinXP also gives sound

Comment 30

[jonathan chetwynd]

http://tech.groups.yahoo.com/group/svg-developers/message/56788

a particularly clear message from Jon Ferraiolo on audio support:

Hi Jonathan,
You asked, so I will answer. My opinion on audio and video is that I hope
the browser vendors see the multimedia light and implement the SMIL timing
and animation modules. They have to implement most of it anyway for SVG
1.1, so why not have a bit of foresight and:

* implement the few extra bits needed for future support for what is needed
for SVG-t 1.2
* implement the timing and animation engines as separate modules from SVG
so that it can be used on HTML also (similar to HTML+TIME in IE5.5)
* support SVG-t 1.2's audio and video tags in conjuntion with SVG content
* support audio and video content in conjunction with HTML's object tag

The tricky part is inclusion of industry-standard codecs, some of which
require paying licensing fees, which is hard for freely downloadable
software. To get around this issue, the browser vendors should hook into
existing audio/video player software (QuickTime, WMP, even maybe Flash) via
the HTML object tag which they control from their built-in SMIL engine.

I think this is an important issue for that part of the industry that wants
to create standards-compliant content and not rely on proprietary formats
and single-vendor runtimes. Multimedia is hitting the mainstream (driven in
part by all of those young people uploading bad videos for the world to
see). We need a standards-based approach to playing that content in
conjunction with rich user interfaces.

Jon

Jon Ferraiolo Web Architect, Emerging Technologies

--

I wrote:

among other significant outstanding bugs that mozilla/firefox is being really slow to resolve is the issue of audio or sound.

Aywk adobe had sound support from the start as does flash. in fact many authors use flash solely to provide audio on webpages.

I just wondered whether you had considered this issue and whether you felt it had relevance.

Comment 31

[jonathan chetwynd]

Attachment: object test for mp3

Comment 32

[jonathan chetwynd]

Irène pointed out that <object> alone should be sufficient, it works in html, but not when wrapped in foreignobject svg

Comment 33

[jonathan chetwynd]

Attachment: object without embed

Comment 34

[jonathan chetwynd]

Attachment: object in html

Comment 35

[jonathan chetwynd]

Attachment: <object> in html plays audio

Comment 36

[jonathan chetwynd]

Attachment: <object> in SVG foreignobject audio broken

Comment 37

[jonathan chetwynd]

#35 & #36 should make this bug clear enough.

my apologies, for the time it has taken to develop them.

a similar bug is filed by me with amaya, webkit, opera and others, so please bear with me....

as I dance between standards compliance and current functionality using embed, innerHTML whatever, and cope with short-term memory loss.

Comment 38

[jonathan chetwynd]

Attachment: <object data=...> works

Comment 39

[jonathan chetwynd]

okay so the attachment doesn't work as such\
but that's a separate issue something to do with the way it's being served.

try http://peepo.co.uk/temp/data.svg

the kind people at webkit pointed out that src= is not part of the xhtml1.1 standard and data= should be used. mind you it's not working on webkit yet ~:"

Comment 40

[jonathan chetwynd]

#39 re: linux mandriva 2007 'free' using ff nightly

downloading the sound file opens "totem" automatically.

but loading the SVG file http://peepo.co.uk/temp/data.svg does not.

how to tell if this is a plugin issue?