When running a browsertime test with `--browsertime-visualmetrics`, the dependencies should be installed but appear to be failing often. The outcome on linux: - `ffmpeg` is listed as `FAIL` while other dependencies are `OK` ran the following, and all pass, but when running the test again, ffmpeg fails again - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same - per :sparky 's suggestion I downloaded ffmpeg and added it to PATH: https://github.com/ncalexan/geckodriver/releases/download/v0.24.0-android/ffmpeg-4.1.4-i686-static.tar.xz - was able to run visual metrics test without additional steps - see: https://searchfox.org/mozilla-central/source/testing/raptor/mach_commands.py#188-190 Outcome on osx: `convert` and `compare` `FAIL` ran the following but made no impact, convert and compare still fail: `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same Will run on Windows as well to see what the outcome is
Bug 1735410 Comment 0 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
When running a browsertime test with `--browsertime-visualmetrics`, the dependencies should be installed but appear to be failing often. The outcome on linux: - `ffmpeg` is listed as `FAIL` while other dependencies are `OK` ran the following, and all pass, but when running the test again, ffmpeg fails again - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same - per :sparky 's suggestion I downloaded ffmpeg and added it to PATH: https://github.com/ncalexan/geckodriver/releases/download/v0.24.0-android/ffmpeg-4.1.4-i686-static.tar.xz - was able to run visual metrics test without additional steps - see: https://searchfox.org/mozilla-central/source/testing/raptor/mach_commands.py#188-190 Outcome on osx: `convert` and `compare` `FAIL` ran the following but made no impact, convert and compare still fail: `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same Will run on Windows as well to see what the outcome is
When running a browsertime test with `--browsertime-visualmetrics`, the dependencies should be installed but appear to be failing often. The outcome on linux: - `ffmpeg` is listed as `FAIL` while other dependencies are `OK` ran the following, and all pass, but when running the test again, ffmpeg fails again - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same - per :sparky 's suggestion I downloaded ffmpeg and added it to PATH: https://github.com/ncalexan/geckodriver/releases/download/v0.24.0-android/ffmpeg-4.1.4-i686-static.tar.xz - was able to run visual metrics test without additional steps - see: https://searchfox.org/mozilla-central/source/testing/raptor/mach_commands.py#188-190 Outcome on osx: - `convert` and `compare` `FAIL` ran the following but made no impact, convert and compare still fail: - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same Will run on Windows as well to see what the outcome is
When running a browsertime test with `--browsertime-visualmetrics`, the dependencies should be installed but appear to be failing often. The outcome on linux: - `ffmpeg` is listed as `FAIL` while other dependencies are `OK` ran the following, and all pass, but when running the test again, ffmpeg fails again - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same - per :sparky 's suggestion I downloaded ffmpeg and added it to PATH: https://github.com/ncalexan/geckodriver/releases/download/v0.24.0-android/ffmpeg-4.1.4-i686-static.tar.xz - was able to run visual metrics test without additional steps - see: https://searchfox.org/mozilla-central/source/testing/raptor/mach_commands.py#188-190 Outcome on osx: - `convert` and `compare` `FAIL` ran the following but made no impact, convert and compare still fail: - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same (unresolved) Will run on Windows as well to see what the outcome is
When running a browsertime test with `--browsertime-visualmetrics`, the dependencies should be installed but appear to be failing often. The outcome on linux (resolved): - `ffmpeg` is listed as `FAIL` while other dependencies are `OK` ran the following, and all pass, but when running the test again, ffmpeg fails again - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same - per :sparky 's suggestion I downloaded ffmpeg and added it to PATH: https://github.com/ncalexan/geckodriver/releases/download/v0.24.0-android/ffmpeg-4.1.4-i686-static.tar.xz - was able to run visual metrics test without additional steps - see: https://searchfox.org/mozilla-central/source/testing/raptor/mach_commands.py#188-190 Outcome on osx (unresolved): - `convert` and `compare` `FAIL` ran the following but made no impact, convert and compare still fail: - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same Will run on Windows as well to see what the outcome is
When running a browsertime test with `--browsertime-visualmetrics`, the dependencies should be installed but appear to be failing often. The outcome on linux **(resolved)**: - `ffmpeg` is listed as `FAIL` while other dependencies are `OK` ran the following, and all pass, but when running the test again, ffmpeg fails again - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same - per :sparky 's suggestion I downloaded ffmpeg and added it to PATH: https://github.com/ncalexan/geckodriver/releases/download/v0.24.0-android/ffmpeg-4.1.4-i686-static.tar.xz - was able to run visual metrics test without additional steps - see: https://searchfox.org/mozilla-central/source/testing/raptor/mach_commands.py#188-190 Outcome on osx **(unresolved)**: - `convert` and `compare` `FAIL` ran the following but made no impact, convert and compare still fail: - `./mach browsertime --clobber --setup --install-vismet-reqs` - Tried running `mach clobber` and `mach build` and repeating above steps, outcome is the same Will run on Windows as well to see what the outcome is