317695 - Bugzilla Test Suite - QA tests for Selenium

Status: RESOLVED FIXED

(Bugzilla :: Testing Suite, defect)

Description

[Frédéric Buclin]

This is the place to submit your tests for Selenium. No need to request review, no need to request approval. I will apply them myself.

Comment 1

[Frédéric Buclin]

For those who want more information about Selenium, and especially how to write tests, go to:
http://selenium.thoughtworks.com/index.html

Comment 2

[Frédéric Buclin]

If you need to click a submit button which has no name nor id, you can use this trick:

clickAndWait //input[@type='submit']

assuming there is only one button in the form. Else each button has a name already, so you can use it directly.

Comment 3

[Frédéric Buclin]

Attachment: user-extensions.js 1.0.0 (2005-11-27)

Implementing doLoadConfigFile() and doStoreParams() which permit you to write scripts independently of your local configuration. The parameters are stored in config.html which is in the same directory as the main file called by TestRunner.html.

Comment 4

[Frédéric Buclin]

(In reply to comment #3)
> Implementing doLoadConfigFile() and doStoreParams()

Call these functions as in the example below:

loadConfigFileAndWait | &nbsp; | &nbsp; <--- "AndWait" is important, else the script goes to the next instruction before config.html is completely loaded, and misses the parameters contained in this file.

storeParams | foo, bar, baz | &nbsp; <--- load and store parameters in variables having the same name. This way, you can use them later by calling ${foo}, ${bar}, ${baz}. config.html should contain all parameters which are specific to installations (such as the 'urlbase' Bugzilla parameter, which is here called 'inst').

Comment 5

[Frédéric Buclin]

Attachment: template.html

Use this template to write your scripts. The first two commands are mandatory.

Comment 6

[Frédéric Buclin]

Attachment: template.html

err... missing "AndWait".

Comment 7

[Frédéric Buclin]

Attachment: SeleniumTest.pm

SeleniumTest.pm is required when running tests using runtests.pl. Note that user-extensions.js is still useful in this case.

Comment 8

[Frédéric Buclin]

Attachment: 012qa.t (example)

Here is an example of a script for runtests.pl using Selenium.

And here is the output of such script:

[buclin@antares bugzilla]$ ./runtests.pl -v
t/012qa....1..7
ok 1 - Load query.cgi
ok 2 - Check title
ok 3 - Enter and check input in the short_desc field
ok 4 - Recheck the input (using a different method)
ok 5 - Submit request (-> buglist.cgi)
ok 6 - Check title
ok 7 - Make sure that no bug is returned (0 bug found)
ok
All tests successful.

Comment 9

[Frédéric Buclin]

Some more information available here:

http://wiki.mozilla.org/Bugzilla:QA

Comment 10

[Frédéric Buclin]

Attachment: updated 012qa.t (independent of the installation path) (example)

As we are going to test different versions of Bugzilla, and running different DBs, I have updated 012qa.t to be independent of the installations being tested. This is better than duplicating the tests for each installation.

This script requires ConfigTest.pm which will posted in a few minutes.

Comment 11

[Frédéric Buclin]

Attachment: ConfigTest.pm

ConfigTest.pm is equivalent to config.html for TestRunner.html. This way, you can write all your .t scripts without having to think about where it will be run.

Comment 12

[Frédéric Buclin]

Attachment: ConfigTest.pm (includes print_info())

print_info() should be called everytime you shift to another test or installation. 012qa.t is modified as follows:

foreach my $bz_inst (@{$inst->{'220compat'}}, @{$inst->{'222compat'}}) {
    print_info($bz_inst);
    $test->open_ok(... unchanged ...);

print_info() prints the time in GMT when the test is executed, the name of the installation being tested, and repeat the name of the current script (useful when you have many tests in a single script and you don't want to scroll back).

Comment 13

[Frédéric Buclin]

_RSZ_ pointed me to an interesting Firefox extension, a Selenium recorder:

http://seleniumrecorder.mozdev.org/

I did some basic tests and it seems pretty helpful for those who don't want to write scripts manually.

Note that if you install this extension, you don't need to download Selenium separately; it's included in the extension already (except that the XPI doesn't include samples and docs).

Comment 14

[Frédéric Buclin]

Attachment: user-extensions.js 1.0.1 (2006-01-12)

Updated version including two new commands:

SelectNone('locator') : unselect all options of a listbox <select> ... </select>
SelectMulti('locator', 'optionList') : select several options in a list box.

Read comments in the file for more information. I'm going to update the actual version on landfill too.

Comment 15

[Frédéric Buclin]

Attachment: user-extensions.js 2.0 (2006-01-13)

Include commands created by Andrey Yegorov, see the changelog in the file. These commands permit us to do conditional testing ("if then else", "goto" and "while").

Comment 16

[Frédéric Buclin]

Attachment: user-extensions.js 2.1 (2006-01-14)

* Version: 2.1 - 2006-01-14 [e-mail]
 * Add the assertFlatText(Not)Present() functions. They work in a similar way as assertText(Not)Present()
 * but don't take care about newlines and consecutive whitespaces.

Comment 17

[Paul]

Attachment: version 2.2 (2006-01-15)

Comment 18

[Frédéric Buclin]

(In reply to comment #17)
> Created an attachment (id=208553) [edit]
> version 2.2 (2006-01-15)
> 

The file I committed on landfill is slightly different. I moved your functions earlier in the code, with other doFoo functions. But I didn't change the functions themselves. So landfill is now using v2.2.

Comment 19

[Frédéric Buclin]

Attachment: user-extensions.js, v2.2.1 (2006-01-16)

v2.2 has serious bugs (one of the function overwrites existing variables)

Comment 20

[Greg Hendricks]

Attachment: targetmilestones_on_off

Selenium script to test turning on/off target milestones.
This is my first try at a selenium script. Hope it works ^.^

Comment 21

[Paul]

Bugzilla test suite does not seem to work in Internet Explorer
Only 3 tests pass

Comment 22

[Frédéric Buclin]

(In reply to comment #21)
> Bugzilla test suite does not seem to work in Internet Explorer
> Only 3 tests pass
> 

I know. But I haven't time to worry about.

Comment 23

[victory <[e-mail]>]

Attachment: add assertRegexText(Not)Present(regex,flag)

Comment 24

[victory <[e-mail]>]

Attachment: user-extensions.js, v2.3.1 (2006-01-20)

Comment 25

[Frédéric Buclin]

(In reply to comment #24)
> Created an attachment (id=209072) [edit]
> user-extensions.js, v2.3.1 (2006-01-20)
> 

ok, landfill now points to v2.3.1.

Comment 26

[Frédéric Buclin]

Attachment: user-extensions.js, v2.4 (2006-01-22)

add 'flatlink=' which allows you to easily click on links containing newlines and several consecutive whitespaces.

Comment 27

[Frédéric Buclin]

Attachment: user-extensions.js, v2.5 (2006-01-23)

includes assertSelect(Not)PresentOptions(select, options_list).

Comment 28

[victory <[e-mail]>]

Attachment: user-extensions.js, v2.5.1 (2006-01-30)

please check if this work correctly when run script already on landfill

Comment 29

[Frédéric Buclin]

Comment on attachment 210126 [details]
user-extensions.js, v2.5.1 (2006-01-30)

requires no official review

Comment 30

[victory <[e-mail]>]

Attachment: user-extensions.js, v2.6 (2006-04-05)