672318 - QA testing for wiki.mozilla.org prod/stage

Status: RESOLVED WONTFIX

(Testing Graveyard :: WebQA, defect)

Description

[Jake Maul [:jakem]]

Preferably, I would like to have some type of basic "smoketest" stuff for the prod site (wiki.mozilla.org), and the same or more involved testing on a new stage site we're working on, wiki.allizom.org (not yet alive).

We don't make a lot of changes to this site, but when we break something it does get noticed. Currently we have zero testing, and this has resulted in a few situations lately where a skin change (or similar) has caused some pain.

I think at a minimum we need to have testing that hits a few pages on the site, logs in, checks version history of a page, edits a page, and maybe makes a new page and then marks it for deletion. That should cover the major functionality.

Comment 1

[Jake Maul [:jakem]]

Pulling in dria, who's one of the bigger wikimo users. Do you have any additional suggestions for what should be covered in the first round of tests? I'm not sure how in-depth we can get, but if I've missed something critical please let us know. Thanks!

Comment 2

[Stephen Donner [:stephend] Not actively reading bugmail]

Let's continue adding to/refining https://wiki.mozilla.org/QA/Execution/Web_Testing/Wiki_Test_Coverage.

Comment 3

[Deb Richardson [:dria] (plz NEEDINFO)]

How detailed & comprehensive do you want that Wiki Test Coverage list?  I'm not sure if I should be adding things like "Make sure user prefs work", etc.

Comment 4

[Jake Maul [:jakem]]

For now I'm mostly concerned about testing things that people are likely to run into that would affect their ability to do work. To me that would mean viewing, editing, creating, and possibly deleting pages. Anything else you do in the wiki on a regular basis would be good too.

It might be good if the tests covered some Semantic MediaWiki and Semantic Forms use cases as well, although I don't have any idea how those work or how difficult that might be.

Comment 5

[Dave Hunt [:davehunt] [he/him] ⌚BST]

We did create a small suite of tests for the wiki at https://github.com/mozilla/wiki-tests, but we shut it down earlier this year due to the lack of an owner/maintainer. We could always revisit it again in the future.