Open Bug 1954206 Opened 1 month ago Updated 1 month ago

Build Support Scripts for Automanual testing

Categories

(Mozilla QA :: Update Testing, task)

Product:
Mozilla QA
Component:
Update Testing
Version:
Version 4
Type:
task

Tracking

(Not tracked)

People

(Reporter: benchatt, Unassigned)

References

(Depends on 2 open bugs, Blocks 1 open bug)

Details

The DTE-Manual actual test cases are not the ones outlined in TestRail. Instead the manual team tests a simple update scenario with a number of axes of variation to ensure updates are robust for expected use cases. We will assume the test case is as follows:

  • Update the application
  • Check that the application version number is correct
  • Navigate to an example web page and ensure that it seems correct

The axes of variation are as follows, in priority order:

  • Operating System
  • OS version
    • Mac 10.15, 12, 13, 14
    • Ubuntu 22
    • Win 10, 11
  • Channel
    • beta-localtest
    • beta
    • aurora
  • Source version
    • beta-localtest: Within target version minus 2.0, various minor versions
    • beta and aurora: Within target version minus 5.0, various minor versions
  • Windows: BITS enabled and disabled
  • MacOS: Admin and Standard users
  • Build locale

We need support scripts to build out testing along all of these axes, prioritizing the top of the list

Depends on: 1954208
Depends on: 1954209
Depends on: 1954210
Depends on: 1954211
No longer depends on: 1954211
You need to log in before you can comment on or make changes to this bug.