Open Bug 1539421 Opened 7 years ago Updated 3 years ago

when stockwell adds a needswork or disable-recommended whiteboard tag, add the platform as well

Categories

(Testing :: General, enhancement, P3)

Version 3
enhancement

Tracking

(Not tracked)

People

(Reporter: jmaher, Unassigned)

Details

our script that runs from treeherder to add whiteboard tags of [stockwell needswork] or [stockwell disable-recommended] could provide more value to the sheriffs and developers by adding a [<platform>] whiteboard tag of what is affected.

Given that we have 20+ configs, it would be difficult to track all configs (shippable, debug, asan, ccov), but I think we could realistically track high level:
android
linux
osx
windows

of course this doesn't account for the different variations like windows7-32 or windows10-64 or windows10-64/aarch64, but it gives a good indication of what we have.

some exceptions to consider:

  • when an intermittent bug goes from [stockwell needswork] -> [stockwell unknown], we would still have the platform whiteboard tag listed
  • when we disable a test, then it needs work on a different platform, we could have [stockwell disabled][windows] -> [stockwell needswork][windows][osx] or if it was disabled on debug and now needs to be disabled on !debug, then we wouldn't be sure.

Overall, I think ignoring the exceptions and understanding this isn't perfect, it can provide more insight into what we are doing work on.

:gbrown, do you have thoughts on this?

Flags: needinfo?(gbrown)

I'm not sure I understand the added value.

Comments already include platform info like

Platform breakdown:

    linux32-devedition: 1
    linux64: 3
    osx-cross: 1
    osx-cross-ccov: 11
Flags: needinfo?(gbrown)

I propose this as it is difficult in a bugzilla query to get information- while the platform breakdown is useful, it does leave some questions to be desired and is not easy to query.

Priority: -- → P3
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.