364366 - add testcase-wanted and regressionwindow-wanted to |keywords|

Status: VERIFIED FIXED

(bugzilla.mozilla.org :: Administration, task)

Description

[Peter van der Woude [:Peter6]]

the above keywords would make it a lot easier for people going through bugs to filter for usefull things that may be missing in a (regression)bug.

Comment 1

[timeless]

we already have a testcase flag, i'm not sure i really want to add a keyword.

and regressionwindow-wanted is *way* too long for my tastes. it also feels fairly flagy.

Comment 2

[timeless]

gavin's in favor of at least one of them. please provide descriptions and i'll set them up, i guess...

i'd still rather testcase share the flag we already have.

Comment 3

[Peter van der Woude [:Peter6]]

quote:
  testcase: 
  Indicates that a simplified test case is done and included in bug report.

So what if the testcase isn't done , how do we know where it is badly needed (besides reading every single bug filed) ?

Comment 4

[Peter van der Woude [:Peter6]]

regressionwindow-wanted:
This bug is knows to have regressed but it is unknown when this happened, or the currently known regressionwindow spans too much time.It needs to be narrowed down as much as possible.

|qawanted| kinda covers both keywords, but is too vague about what is needed.

Comment 5

[Peter van der Woude [:Peter6]]

testcase-wanted:
 this bug needs a (further) reduced testcase.

Comment 6

[Martijn Wargers (dead)]

I'm always eager to get a regression window, because I can then cc the developers that caused the bug. It increases the chance significantly that it gets fixed on time. Also, sometimes it gives a better indication of why things screw up.

Personally, I think the keywords 'regression' and 'qawanted' already cover what you want here. If it is a regression and the regression window is unknown, then it should get the 'qawanted' keyword, when a regression window would be handy.

What I would like to have is a way to search for bugs that have regressed in a certain time-frame, so you could query for all the regression in the Gecko1.9 release for instance. Maybe a date input field for the regression date would be handy?

Comment 7

[Jesse Ruderman]

I don't think the "qawanted" keyword does a good job of covering things like "testcase wanted" and "regression window wanted", precisely because it covers too many things.  Some people are good at making reduced testcases, or are working on tools to automate testcase reduction.  Some people have lots of builds handy, or are working on tools to automate finding regression windows.  With more keywords, it would be much easier to find bugs in need of certain kinds of attention.

Comment 9

[Reed Loden [:reed]]

Is this still wanted? If so, can a consensus on what to do be made?

Comment 10

[Samuel Sidler (old account; do not CC)]

For what it's worth, I've currently been using status whiteboard entries to track when a testcase or regression window is wanted.

Comment 11

[Gervase Markham [:gerv]]

The "testcase" flag currently applies only to Bugzilla. We could extend that and deprecate the testcase keyword, although that involves a lot of people changing their practices. So perhaps another keyword is the right additive approach.

testcase-wanted would be particularly good for BugAThon-type things. Instead of people having to search and guess what bugs might need testcases.

I have no strong opinion on regressionwindow-wanted, although it does seem like everything recent which is marked "regression" could do with a narrow regression window.

Gerv

Comment 12

[Jesse Ruderman]

Flags are a pain to use and search for.  I prefer sticking with keywords.

Comment 13

[Smokey Ardisson (offline for a while; not following bugs - do not email)]

I was on the fence about this before, but the more I think about it, the more I agree with Jesse in comment 7 and part of Gerv's comment 11 about BugAThon-type things.  

Certainly regression-range-wanted would be very useful for an easy entry point to QA/triage for "new" folks on a Bug Day or whatnot, since anyone can download builds and check to see if a problem exists--and as Jesse notes again in comment 12, flags are a pain to search for, but it's pretty simple to search for a keyword and come up with a list of bugs to test in these downloaded builds.

Moreover, if we can save people who have the skills to make testcases the time that it takes to find bugs needing them, that's more time for making testcases.

Adding these two keywords would then let qawanted handle only the nebulous cases where someone has to sit down and "figure out what the heck is going on."

Comment 14

[Gervase Markham [:gerv]]

OK. Do we just add the keyword and then tell people about it, or do we want to check with some big QA cheeses first? Who would that be?

Gerv

Comment 15

[Jesse Ruderman]

It would be nice if we could come up with something shorter than
"regressionwindow-wanted".

Comment 16

[Smokey Ardisson (offline for a while; not following bugs - do not email)]

(In reply to comment #15)
> It would be nice if we could come up with something shorter than
> "regressionwindow-wanted".

We could use "range" instead of "window", but that only buys 1 letter.  Another option would be to shorten "regression" somehow, but that probably hurts understandability: regrange-wanted :P

Comment 17

[Gervase Markham [:gerv]]

I've added both keywords. Let's see what happens :-)

Gerv