1087520 - Leaderboard for One and Done

Status: VERIFIED FIXED

(Mozilla QA Graveyard :: One and Done, defect, P1)

Description

[Karl Thiessen [:kthiessen, he/him]]

+++ This bug was initially created as a clone of Bug #1075645 +++

Separating this task from the main body of bug 1075645:

* Identify top contributors who come multiple times, complete multiple tasks, highlight reaching out to them to make connections

There are discussions about gaming the system, etc. to be had about this task that don't necessarily apply to the rest of these metrics.

Comment 1

[Bob Silverberg [:bsilverberg]]

We discussed this in this week's meeting and here are some notes:
- We _should_ count multiple executions of the same task. It is acceptable (and encouraged) for users to execute the same task multiple times in some cases.
- We will not include any tasks that were completed in less time than the threshold, which is currently 2 minutes.
- A link to the Leaderboard will be displayed on the Home Page. The actual list of users will not be displayed directly on the Home Page.
- The Leaderboard will display the user name (which will be a link to the user's profile) and the count of completed tasks
- bitgeeky suggested http://www.codechef.com/rankings/OCT14 as an example of a Leaderboard, but that seems to be much more complex than what we are looking for right now.

Comment 2

[Bob Silverberg [:bsilverberg]]

I have completed the first iteration of this and have deployed it to dev for feedback. Please comment on the change to the home page (which adds a link with the text "Check out our Top Contributors.") and also on the Leaderboard itself.

Once it passes muster I will request a review of the code and get the feature merged.

Comment 3

[Liz Henry (:lizzard) (relman/hg->git project)]

Bob - I can't get the Top Contributors page to load on the dev server.  (https://oneanddone-dev.paas.allizom.org/en-US/tasks/leaderboard/)

Comment 4

[Liz Henry (:lizzard) (relman/hg->git project)]

Ah, nevermind, it finally loaded. It looks good, but I think it will cause confusion for users, since they can see that in a profile, they may be shown to have completed 8 tasks, but not all of them are counted for the leaderboard.  We may want to explain why. 

It would be nice in the future to be able to show leaderboards for different date ranges. Either a flexible date range, or simply the last week, month, and 3 months.

Comment 5

[Bob Silverberg [:bsilverberg]]

This is a good point, Liz. I'm not sure how best to address it though. We could put an asterisk next to the column heading for "Tasks Completed" and add a footnote below the table to say "Excludes tasks with a duration of less than 2 min."

That would address the information issue, but it also might prompt people trying to game the system to just wait for more than 2 minutes before clicking "Complete" on a task. I guess we need to decide how much we want to worry about that behaviour.

What do you folks think?

Comment 6

[Rebecca Billings [:rbillings]]

I actually like the idea of not listing how many tasks the users have done on the actual leaderboard- that removes the complication of differences between the profile and the leaderboard. They are already listed in order, and if someone wants to see how many tasks the top user did they can visit their profile. 

I really like how SUMO does it: https://support.mozilla.org/en-US/community
Admittedly their top user clouds look nicer as they support avatars, but that's another conversation entirely. I think there are a lot of future improvements we could do with dates, avatars, filtering, etc. but this is a good first stab at it.

Comment 7

[Bob Silverberg [:bsilverberg]]

That would certainly resolve the issue. What do you think Liz and Karl?

Comment 8

[Karl Thiessen [:kthiessen, he/him]]

I agree with Rebecca here.

Comment 9

[Bob Silverberg [:bsilverberg]]

Thanks Rebecca and Karl. I have made that modification.

Comment 10

[Ioana Chiorean]

Should I see the change here? https://oneanddone-dev.paas.allizom.org/en-US/tasks/leaderboard/

Comment 11

[Bob Silverberg [:bsilverberg]]

Commit pushed to master at https://github.com/mozilla/oneanddone

https://github.com/mozilla/oneanddone/commit/5ec9bf174ed052ddd94dd8779e770b18e265ae6f
Bug 1087520 - Leaderboard for One and Done

Comment 12

[Bob Silverberg [:bsilverberg]]

Ioana: it was awaiting a review first, but now it has passed review and the up to date version has been pushed to both dev and staging.

Comment 13

[Rebecca Billings [:rbillings]]

Verified leaderboard displays correctly, and no longer shows counts.

Comment 14

[Rebecca Billings [:rbillings]]

Also verified on prod.