1474502 - [wpt-sync] Sync PR 11876 - [html] Reduce test duration

Status: RESOLVED FIXED

(Core :: Audio/Video: Playback, enhancement, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 11876 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/11876
Details from upstream follow.

Mike Pennisi <[e-mail]> wrote:
>  [html] Reduce test duration
>  
>  The `audio_loop_base.html` and `video_loop_base.html` tests were written
>  to verify playback looping, making it necessary to play a given media
>  file in its entirety.
>  
>  Prior to the application of this patch, the modified tests were among
>  the longest-running tests in WPT [1]. Because media files of any
>  duration may be used to validate playback looping, the selected files'
>  4-second duration was unnecessary.
>  
>  Introduce media procedurally-generated media files with minimal duration.
>  Update the tests to reference these new files, drastically reducing the
>  time required to execute them.
>  
>  The files were created via the following commands (using ffmpeg version
>  2.8.14):
>  
>      $ ffmpeg -f lavfi -i anullsrc=r=44100:cl=mono -t 0.05 -q:a 9 -acodec libmp3lame media/sound_0.mp3
>      $ ffmpeg -f lavfi -i anullsrc=r=44100:cl=mono -t 0.05 -q:a 9 -acodec libvorbis media/sound_0.oga
>  
>      $ ffmpeg \
>          -f lavfi \
>          -i anullsrc=r=44100:cl=mono -ac 1 \
>          -i media/1x1-green.png -loop 1 -vframes 1 -pix_fmt yuv420p -vf scale=2:2 \
>          -shortest -acodec libmp3lame -vcodec libx264 -map 0:a -map 1:v \
>          media/2x2-green.mp4
>      $ ffmpeg \
>          -f lavfi \
>          -i anullsrc=r=44100:cl=mono -ac 1 \
>          -i media/1x1-green.png -vframes 1 -pix_fmt yuv420p -vf scale=2:2 \
>          -shortest -acodec libvorbis -vcodec libtheora -q:a 9 -map 0:a -map 1:v \
>          media/2x2-green.ogv
>  
>  [1] https://github.com/web-platform-tests/wpt/issues/11571
>  
>  ---
>  
>  The following command runs the tests in Firefox and outputs information about
>  the result:
>  
>      $ ./wpt run --log-wptreport >(python -m json.tool | awk '/"duration"/,/"test"/ {print}') firefox html/semantics/embedded-content/media-elements/{audio,video}_loop_base.html
>  
>  Run against `master`, it produces the following output:
>  
>      "duration": 12087,
>      "message": null,
>      "status": "OK",
>      "subtests": [
>          {
>              "message": null,
>              "name": "Check if video.loop is set to true that expecting the seeking event is fired more than once",
>              "status": "PASS"
>          }
>      ],
>      "test": "/html/semantics/embedded-content/media-elements/video_loop_base.html"
>      "duration": 10753,
>      "message": null,
>      "status": "OK",
>      "subtests": [
>          {
>              "message": null,
>              "name": "Check if audio.loop is set to true that expecting the seeking event is fired more than once",
>              "status": "PASS"
>          }
>      ],
>      "test": "/html/semantics/embedded-content/media-elements/audio_loop_base.html"
>  
>  With this patch applied, the tests continue to pass, but they do so with a much
>  shorter duration:
>  
>      "duration": 820,
>      "message": null,
>      "status": "OK",
>      "subtests": [
>          {
>              "message": null,
>              "name": "Check if video.loop is set to true that expecting the seeking event is fired more than once",
>              "status": "PASS"
>          }
>      ],
>      "test": "/html/semantics/embedded-content/media-elements/video_loop_base.html"
>      "duration": 1147,
>      "message": null,
>      "status": "OK",
>      "subtests": [
>          {
>              "message": null,
>              "name": "Check if audio.loop is set to true that expecting the seeking event is fired more than once",
>              "status": "PASS"
>          }
>      ],
>      "test": "/html/semantics/embedded-content/media-elements/audio_loop_base.html"

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try https://treeherder.mozilla.org/#/jobs?repo=try&revision=4a44a9559bc81ba1363a524ede437a7cdab5f468

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=b09cf0cb992f9d53a0774838634c9e722f4a8730

Comment 3

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Ran 2 tests and 2 subtests
OK     : 2
PASS   : 2

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/00994e529745
[wpt PR 11876] - [html] Reduce test duration, a=testonly

Comment 5

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/00994e529745