739419 - (reviewer-incentives) [tracking] Reviewer Incentives!

Status: RESOLVED FIXED

(addons.mozilla.org Graveyard :: Admin/Editor Tools, defect)

Description

[Gregory Koberger (:gkoberger)]

Our reviewers make us happy, so let's make them happy.

Here's the spec:
https://docs.google.com/document/pub?id=14QAGYPHocnnK0EHPzsoWxNkwUjBgCvvEaxH4rFkS9UY

Comment 1

[Andy McKay]

Does @cvan get a sticker for all his code reviews?

Comment 2

[Gregory Koberger (:gkoberger)]

For this quarter, the priorities are bug 739428, bug 739429 and bug 739430, along with a simple leaderboard for the past 7 days and all time on the main screen.

Comment 3

[Wil Clouser [:clouserw]]

(In reply to Gregory Koberger (:gkoberger) from comment #2)
> For this quarter, the priorities are bug 739428, bug 739429 and bug 739430,
> along with a simple leaderboard for the past 7 days and all time on the main
> screen.

thanks for update

Comment 4

[Wil Clouser [:clouserw]]

goal is hit for Q2, -> no milestone

Comment 5

[KLB]

On point scoring, one add-on type that needs special consideration are multi-part installs as we are frequently seeing with full themes that have options panels.  These add-ons require a full theme review (https://wiki.mozilla.org/AMO:Editors/EditorGuide/ThemeReviews) plus an extension review of the options panel. It is like reviewing two add-ons in one.

While shortcuts can be taken when reviewing updates to previously approved full themes, doing a complete review of a full theme also takes considerable work. As such, it might be a good idea to provide extra points for reviews of newly added themes that have not been reviewed before. Related to this, doing a complete review of a Sea Monkey full theme takes a lot more work than reviewing Firefox or Thunderbird themes and Sea Monkey themes tend to languish in the theme queue because not as many editors are comfortable reviewing Sea Monkey themes so awarding extra points for Sea Monkey themes would be warranted.  

For reference as to how long a through review of a theme takes, I tend to spend 1/2hr to 1hr reviewing a theme. I do pretty detailed reviews, so I may be taking longer than other editors. I will speed up some and skip some tests from the theme review guidelines for themes that I have reviewed several times if I'm comfortable with the theme developer's habits (I never take shortcuts on security issues).

Comment 6

[Andy McKay]

This tracker only has two bugs on. Closing in an attempt to clear out old trackers. Looks like the incentives work pretty well.