1340305 - Add docs (and make it easier) to run selenium tests locally

Status: RESOLVED FIXED

(Tree Management :: Treeherder, defect)

Description

[William Lachance (:wlach)]

In bug 1339547, I added some selenium tests to Treeherder. We don't really have a good story for running them locally though. I think we need to do the following:

* Install known-good copies of firefox, geckodriver, and xvfb inside the vagrant environment using puppet,
* Add some testing glue to make sure that they're set up and used when runtests.sh is run.

Comment 1

[Ed Morley [:emorley]]

(In reply to William Lachance (:wlach) (use needinfo!) from comment #0)
> * Install known-good copies of firefox, geckodriver, and xvfb inside the
> vagrant environment using puppet,

Since this bug was filed, Firefox now supports headless mode, so we can skip the xvfb nonsense :-)

The steps are therefore:
* Copy the geckodriver/Firefox download & MOZ_HEADLESS=1 steps from here: https://github.com/mozilla/treeherder/blob/6a132dee0c56b1c4d13da54bbc5ca56a00b777f4/bin/travis-setup.sh#L52-L62
* Add them to vagrant/setup.sh, adjusting slightly to ideally ensure they only run if changes are required
* Adjust runtests.sh to invoke the selenium tests too
* Update the testing docs here (for people who run the tests manually outside of runtests.sh): https://treeherder.readthedocs.io/common_tasks.html#running-the-tests

Comment 2

[Ed Morley [:emorley]]

(In reply to Ed Morley [:emorley] from comment #1)
> * Add them to vagrant/setup.sh

Or for MOZ_HEADLESS/PATH adjustments: vagrant/env.sh


> adjusting slightly to ideally ensure they only run if changes are required

For the Firefox beta download this won't really be possible I guess, since it's not version-pinned.

Comment 3

[GitHub Autolander Bot]

Attachment: [treeherder] davehunt:bug1340305 > mozilla:master

Comment 4

[Treeherder GitHub Bugbot]

Commit pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/9fd3c7224161b5440b5b541bfcd18a552b377440
Bug 1340305 - Allow Selenium tests to be run locally