Open Bug 1853232 Opened 2 years ago Updated 6 months ago

Update raptor tp6 unittest test list

Categories

(Testing :: Raptor, task, P3)

task

Tracking

(Not tracked)

People

(Reporter: kshampur, Unassigned)

References

Details

(Whiteboard: [fxp])

this should be a fairly small change.

this test list here is outdated (e.g. we don't have just a 'google' manifest for tp6 desktop, google-search might be a more appropriate replacement here, or anything else we have a recording manifest for)

this would also have to be updated based on the changes to the tp6 unittest config

The .rst file for perfdoc as well.

A user may accidentally run a raptor test with e.g. google, and the error message one gets will be something like <...>/mitm7-linux-firefox-google.manifest) does not exist. Please provide a valid path! this is confusing because it suggests google might be a valid test (which it is for android, but not desktop) and that the manifest is just missing.

what should happen instead is test 'google' could not be found for ... which is the typical error message for invalid tests.

to elaborate a bit more what is happening

https://searchfox.org/mozilla-central/rev/1cae9ca7cc7d17cfc92088dfc68e5ff391128caa/testing/raptor/raptor/manifest.py#343 that lists available tests, and since google exists in the tp6-unittest.ini, it is considered an available test

Severity: S3 → S4
You need to log in before you can comment on or make changes to this bug.