1084983 - Possible smoke test suggestions for dev/contributors

Status: RESOLVED FIXED

(Tree Management :: Treeherder, enhancement, P5)

Description

[Jonathan French (:jfrench)]

It crossed my mind, it might be handy to have a simple, very small list of key functionality to run through (or if we get fancy later some automated equivalent) to test a local instance of treeherder before opening PR's.

For example testing pinning, repo switching, filters, etc, or whatever has historically proven fragile.

We might want one for people who are staff and have full functionality access, or a subset which works for anyone.

We could possibly post this bullet point list on the Wiki as a link in the Contributing section. Not that it would be mandatory, but it may help encourage that mindset during development and prior to commits.

Comment 1

[Jonathan French (:jfrench)]

camd has an etherpad going of potential tests, so cross referencing them here
https://etherpad.mozilla.org/treeherder-test-checklist

Comment 2

[Jonathan French (:jfrench)]

We might similarly want to run through these smoke tests on an instance eg. stage, before a push to production.

Comment 3

[Jonathan French (:jfrench)]

Camd has migrated the wip test list from etherpad to moztrap
https://moztrap.mozilla.org/runtests/environment/6497

Comment 4

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.allizom.org/logviewer.html#?repo=try&job_id=2952385
repository: try
start_time: 2015-04-01T06:04:24
who: tojonmz[at]gmail[dot]com
machine: unknown
revision: 96e5a8bf7cab

Comment 5

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.allizom.org/logviewer.html#?repo=try&job_id=2952385
repository: try
start_time: 2015-04-01T06:04:24
who: tojonmz[at]gmail[dot]com
machine: unknown
revision: 96e5a8bf7cab

Comment 6

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.allizom.org/logviewer.html#?repo=mozilla-inbound&job_id=4710141
repository: mozilla-inbound
start_time: 2015-04-16T10:08:19
who: tojonmz[at]gmail[dot]com
machine: unknown
revision: 3ce00eb66385

Comment 7

[Jonathan French (:jfrench)]

We've been using these tests for a while prior to deployments to prod, they're on Moztrap per above, and will evolve there and some subset perhaps as automated tests. So marking this bug Fixed for now.

Comment 8

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.allizom.org/logviewer.html#?repo=mozilla-central&job_id=657674
repository: mozilla-central
start_time: 2015-04-19T21:38:12
who: tojonmz[at]gmail[dot]com
machine: tst-linux32-spot-283
buildname: Ubuntu VM 12.04 mozilla-central opt test cppunit
revision: 50b95032152c

Comment 9

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.allizom.org/logviewer.html#?repo=mozilla-central&job_id=657674
repository: mozilla-central
start_time: 2015-04-19T21:38:12
who: tojonmz[at]gmail[dot]com
machine: tst-linux32-spot-283
buildname: Ubuntu VM 12.04 mozilla-central opt test cppunit
revision: 50b95032152c

Comment 10

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.allizom.org/logviewer.html#?repo=mozilla-central&job_id=659047
repository: mozilla-central
start_time: 2015-04-20T00:40:12
who: tojonmz[at]gmail[dot]com
machine: tst-linux32-spot-349
buildname: Ubuntu VM 12.04 mozilla-central pgo test cppunit
revision: 50b95032152c