The DTE-Manual actual test cases are not the ones outlined in TestRail. Instead the manual team tests a simple update scenario with a number of axes of variation to ensure updates are robust for expected use cases. We will assume the test case is as follows: * Update the application * Check that the application version number is correct * Navigate to an example web page and ensure that it seems correct The axes of variation are as follows, in priority order: * Operating System * OS version * * Mac 10.15, 12, 13, 14 * * Ubuntu 22 * * Win 10, 11 * Channel * * beta-localtest * * beta * * aurora * Source version * * beta-localtest: Within target version minus 2.0, various minor versions * * beta and aurora: Within target version minus 5.0, various minor versions * Windows: BITS enabled and disabled * MacOS: Admin and Standard users * Build locale We need support scripts to build out testing along all of these axes, prioritizing the top of the list
Bug 1954206 Comment 0 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
The DTE-Manual actual test cases are not the ones outlined in TestRail. Instead the manual team tests a simple update scenario with a number of axes of variation to ensure updates are robust for expected use cases. We will assume the test case is as follows: * Update the application * Check that the application version number is correct * Navigate to an example web page and ensure that it seems correct The axes of variation are as follows, in priority order: * Operating System * OS version * Mac 10.15, 12, 13, 14 * Ubuntu 22 * Win 10, 11 * Channel * beta-localtest * beta * aurora * Source version * beta-localtest: Within target version minus 2.0, various minor versions * beta and aurora: Within target version minus 5.0, various minor versions * Windows: BITS enabled and disabled * MacOS: Admin and Standard users * Build locale We need support scripts to build out testing along all of these axes, prioritizing the top of the list
The DTE-Manual actual test cases are not the ones outlined in TestRail. Instead the manual team tests a simple update scenario with a number of axes of variation to ensure updates are robust for expected use cases. We will assume the test case is as follows: * Update the application * Check that the application version number is correct * Navigate to an example web page and ensure that it seems correct The axes of variation are as follows, in priority order: * Operating System * OS version * Mac 10.15, 12, 13, 14 * Ubuntu 22 * Win 10, 11 * Channel * beta-localtest * beta * aurora * Source version * beta-localtest: Within target version minus 2.0, various minor versions * beta and aurora: Within target version minus 5.0, various minor versions * Windows: BITS enabled and disabled * MacOS: Admin and Standard users * Build locale We need support scripts to build out testing along all of these axes, prioritizing the top of the list