1428876 - (testing-product-reorg) Re-organize the Testing product

Status: RESOLVED FIXED

(bugzilla.mozilla.org :: Administration, enhancement, P3)

Description

[Andrew Halberstadt [:ahal]]

Note to bz admins:
The desired list of components is TBD, so there is nothing to do here yet.

The Testing product on bugzilla is woefully out of date. I count ~13 components that could likely be moved to the graveyard without complaint. Another ~5 are pretty small and could likely be merged with related components. Meanwhile there are many projects which warrant their own component but don't yet have one.

Here is my initial proposal for the existing components:
ActiveData -> Data Platform and Tools::ActiveData (?)
Autophone
AWFY
AWSY
BrowserTest -> Testing::Mochitest
Code Coverage
external-media-tests -> Graveyard
Fennec Profile Tool -> Graveyard
Firefox UI Tests
geckodriver
General
httpd.js -> Testing::General
JSMarionette -> Graveyard
Lint -> Firefox Build System and Automation::Lint (might happen in bug 1406536)
Marionette
Minotaur -> Graveyard
Mochitest
Mochitest Chrome -> Testing::Mochitest
Mozbase
mozregression
mozscreenshots
New Frameworks -> Testing::General
Orangutan -> Graveyard
Peptests -> Graveyard
Profile Manager -> Graveyard
Reftest
Sisyphus
ssltunnel -> Testing::General
SutAgent -> Graveyard
Talos
Test Informant -> Graveyard
TPS -> Graveyard
webQA -> Graveyard
web-platform-tests
XPCShell Harness

I'll put this into an etherpad and solicit feedback on the mailing lists before going any further.

Comment 1

[Andrew Halberstadt [:ahal]]

Here's an etherpad with the same proposal:
https://public.etherpad-mozilla.org/p/PFmWKPFfZw

Feel free to modify it and/or add new component proposals to the bottom.

Comment 2

[Andrew Halberstadt [:ahal]]

Here's data on the number of open bugs, plus the most recently modified bug for each component in the Testing product:
https://gist.github.com/ahal/792eae6fafb557a6955d3fd9cf93d94e#file-testing-components-md

This data was derived from the jupyter notebook found in the same gist, it should help make the decision to move components around a little easier.

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

(In reply to Andrew Halberstadt [:ahal] from comment #0)
> TPS -> Graveyard

TPS is still in use. Mark do you know who currently owns this harness? Is it still you?

Comment 4

[Andrew Halberstadt [:ahal]]

I'll leave TPS off the list for now.

Comment 5

[Mark Hammond [:markh] [:mhammond]]

(In reply to Henrik Skupin (:whimboo) from comment #3)
> (In reply to Andrew Halberstadt [:ahal] from comment #0)
> > TPS -> Graveyard
> 
> TPS is still in use. Mark do you know who currently owns this harness? Is it
> still you?

Sorry for the delay - I was on PTO. FYI, it is still owned by the Sync team and still seeing active development and use.

Comment 6

[Bob Clary [:bc] (inactive)]

Please also move Testing:Sisyphus into Graveyard

Comment 7

[Andrew Halberstadt [:ahal]]

Hey Emma and Dylan. I've update the user story with the specific actions that should be taken here. Let me know if you'd prefer I file separate bugs so the breakdown of work is more manageable.

Otherwise, let me know if you need any other information from me. Thanks!

Comment 8

[Dylan Hardison [:dylan] (he/him)]

This part is done:

Move these components to the 'Testing Graveyard' product:
external-media-tests
Fennec Profile Tool
JSMarionette
Minotaur
Orangutan
Peptest
Profile Manager
Sisyphus
SutAgent
Test Informant
webQA

Comment 9

[Dylan Hardison [:dylan] (he/him)]

This part is done:

Merge these components with Testing::Mochitest:
BrowserTest
Mochitest Chrome

Comment 10

[Dylan Hardison [:dylan] (he/him)]

This part is done.

Merge these components with Testing::General
httpd.js
New Frameworks
ssltunnel

Comment 11

[Emma Humphries ☕️🎸🧞‍♀️✨ (she/they) [:emceeaich] (Pacific Time) use needinfo]

Created these new components in Testing

CPPUnitTest
GTest
Mozbase Rust
Python Test

These need triage leads, I've set :ahal for now. Please let me know if that should be different.

Comment 12

[Andrew Halberstadt [:ahal]]

Hey Emma, please set the triage owner for Mozbase Rust to [e-mail].

You can leave the other 3 as me for now, thanks!

Comment 13

[Emma Humphries ☕️🎸🧞‍♀️✨ (she/they) [:emceeaich] (Pacific Time) use needinfo]

Done!

Comment 14

[Joel Maher ( :jmaher ) (UTC -8)]

I still see testing::Sisyphus available, :dylan can you double check that?

Comment 15

[Dylan Hardison [:dylan] (he/him)]

I'll need to put this into the calendar.