linux buildpuppet: install ffmpeg and imagemagick on linux hw testers
Categories
(Infrastructure & Operations :: RelOps: Posix OS, enhancement)
Tracking
(Not tracked)
People
(Reporter: dhouse, Assigned: dhouse)
References
Details
Attachments
(1 file)
bug 1656946 will install these on ubuntu18.04,
can we easily and quickly install them on the existing ubuntu16.04 workers so that the testing changes are not delayed until we move to 18.04?
I downloaded the latest ffmpeg from https://launchpad.net/~jonathonf/+archive/ubuntu/ffmpeg-3
and it installs without trouble on a 1604 worker
so I've added it to the puppetagain custom repos and am deploying it to:
https://firefox-ci-tc.services.mozilla.com/provisioners/releng-hardware/worker-types/gecko-t-linux-talos-beta
I've kicked off a try run to make sure tests pass.
Then I'll add in imagemagick and push that out too.
I ran into failures because I had not pulled down the full set of dependencies. I'm working through that to deploy the upgrade to all of the -beta test pool.
for imagemagick, I took a backport from https://launchpad.net/~laurencelumi/+archive/ubuntu/ppa
I finished the setup of this on build-puppet, but we're waiting on confirmation if there is an alternative (going back into mach/tooltool or something) so that there is a simpler upgrade path and tracking (in one place?) for the versions.
I've kicked off a try run on this test pool, https://firefox-ci-tc.services.mozilla.com/provisioners/releng-hardware/worker-types/gecko-t-linux-talos-beta
This is with ffmpeg and imagemagick backports to ubuntu16:
ffmpeg version 4.3-2~16.04.york1
ImageMagick 6.9.7-4 Q16 x86_64 20170114
(In reply to Dave House [:dhouse] from comment #5)
I've kicked off a try run on this test pool, https://firefox-ci-tc.services.mozilla.com/provisioners/releng-hardware/worker-types/gecko-t-linux-talos-beta
This is with ffmpeg and imagemagick backports to ubuntu16:
ffmpeg version 4.3-2~16.04.york1
ImageMagick 6.9.7-4 Q16 x86_64 20170114
new try run:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=f7ed5c4936458a01f05ad610ac528b9e8cfd1886
:tarek can you check this pool to make sure ffmpeg and the imagemagick tools are reachable?
|
||
Comment 8•4 years ago
|
||
It's able to find and use ffmpeg
thanks!
Let's keep it open until I am past the x11 errors
|
|
||
Comment 9•4 years ago
|
||
Looks like magick is not in the PATH - but that seems wrong since we use convert .
https://firefoxci.taskcluster-artifacts.net/Srw4lBYMQyWBG_dB8UuS9A/0/public/logs/live_backing.log
(working on it)
|
Assignee | |
Comment 10•4 years ago
|
||
(In reply to Tarek Ziadé (:tarek) from comment #9)
Looks like
magickis not in the PATH - but that seems wrong since we useconvert.https://firefoxci.taskcluster-artifacts.net/Srw4lBYMQyWBG_dB8UuS9A/0/public/logs/live_backing.log
(working on it)
These have Imagemagick 6 and not 7 because they are on Ubuntu16. Do you need 7? 6 was available already as a backport, but if you need some newer features, and we don't get the Ubuntu18 upgrade completed for the workers soon, then I can work on a build of IM7.
|
|
Assignee | |
Comment 11•4 years ago
|
||
(In reply to Dave House [:dhouse] from comment #10)
(In reply to Tarek Ziadé (:tarek) from comment #9)
Looks like
magickis not in the PATH - but that seems wrong since we useconvert.https://firefoxci.taskcluster-artifacts.net/Srw4lBYMQyWBG_dB8UuS9A/0/public/logs/live_backing.log
(working on it)
These have Imagemagick 6 and not 7 because they are on Ubuntu16. Do you need 7? 6 was available already as a backport, but if you need some newer features, and we don't get the Ubuntu18 upgrade completed for the workers soon, then I can work on a build of IM7.
(IM6 so there is no "magick" binary)
|
|
||
Comment 12•4 years ago
|
||
It's fine. It's now fully working
It was a bug in the code.
+1 to deploy the queue :)
|
|
Assignee | |
Comment 13•4 years ago
|
||
|
|
Assignee | |
Comment 14•4 years ago
|
||
This change went out to the production linux hardware worker pool last night.
I spot-checked and confirmed the binaries are available and updated:
[root@t-linux64-ms-001 ~]# display --version
Version: ImageMagick 6.9.7-4 Q16 x86_64 20170114 http://www.imagemagick.org
Copyright: © 1999-2017 ImageMagick Studio LLC
License: http://www.imagemagick.org/script/license.php
Features: Cipher DPC Modules OpenMP
Delegates (built-in): bzlib djvu fftw fontconfig freetype jbig jng jpeg lcms lqr ltdl lzma openexr pangocairo png tiff wmf x xml zlib
[root@t-linux64-ms-001 ~]# ffmpeg -version
ffmpeg version 4.3-2~16.04.york1 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.12) 20160609
configuration: --prefix=/usr --extra-version='2~16.04.york1' --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil 56. 51.100 / 56. 51.100
libavcodec 58. 91.100 / 58. 91.100
libavformat 58. 45.100 / 58. 45.100
libavdevice 58. 10.100 / 58. 10.100
libavfilter 7. 85.100 / 7. 85.100
libavresample 4. 0. 0 / 4. 0. 0
libswscale 5. 7.100 / 5. 7.100
libswresample 3. 7.100 / 3. 7.100
libpostproc 55. 7.100 / 55. 7.100
[root@t-linux64-ms-001 ~]# which ffmpeg
/usr/bin/ffmpeg
[root@t-linux64-ms-001 ~]# which display
/usr/bin/display
``
Description
•