951761 - Tracking metrics on Hour of Code Thimble Tutorials

Status: RESOLVED FIXED

(Webmaker Graveyard :: Metrics, defect)

Description

[lainie]

Is there a way to find out how many times each of the following projects was remixed between Dec. 9-15?

* https://thimble.webmaker.org/project/26846/remix
* https://thimble.webmaker.org/project/23490/remix
* https://thimble.webmaker.org/project/22957/remix
* https://thimble.webmaker.org/project/23585/remix
* https://thimble.webmaker.org/project/22915/remix
* https://thimble.webmaker.org/project/26618/remix
* https://thimble.webmaker.org/project/27660/remix

Would like to compile info for a potential Webmaker Hour of Code recap.

Comment 1

[Chris DeCairos (:cade)]

I've got a working API method for this on a local branch. Though, what I've implemented just leverages things we already have.

Every Make knows which make it was remixed from, so I search for makes whose remixedFrom field === the id of the make in question. Then you can count the total results, or, you iterate over each remix result and compare it's createdAt date to a specific Date range, giving you the total number of remixes in a specific time period. This method could be expanded to include some kind of depth level, I.E. remixes of remixes of remixes ....

Comment 2

[Chris DeCairos (:cade)]

Attachment: https://github.com/mozilla/MakeAPI/pull/185

Comment 3

[Chris DeCairos (:cade)]

Attachment: https://github.com/mozilla/makeapi-client/pull/23

This and the above patch implement the remixCount route on the MakeAPI. It takes a Make ID, and a from and to date, and calculates how many makes were made for the given project in the given time range.

I added UI on the Make editor for this. Using the grid, you click on the ID of the make you want to query for, and it's applied to the remix count input below the grid. you select a start and end date using the date input boxes and then press "Get Remix Count". The total count is displayed.

Comment 4

[Chris DeCairos (:cade)]

Could you link the publish URL's of those Makes in comment 0? I'll try and get the data manually tomorrow morning, so we don't have to wait for this to land.

Comment 5

[lainie]

Here you go!
https://artychan.makes.org/thimble/a-rainy-day
https://mopaxian.makes.org/thimble/my-handy-todo-app
https://humphd.makes.org/thimble/coding-maps-with-leafletjs
https://fuzzyfox.makes.org/thimble/tictactoe-tutorial-version
https://nwp.makes.org/thimble/poetry-180-animate
https://techkim.makes.org/thimble/let-it-snow
https://cogdog.makes.org/thimble/corys-mood-room

Comment 6

[Chris DeCairos (:cade)]

I'm not sure if my script is working properly, but here's what I get: https://gist.github.com/cadecairos/1c0f5ad13b3b853e10f5

Are you sure those makes were being remixed?

Comment 7

[Chris DeCairos (:cade)]

aha! It was my code. I was only fetching at most ten remixes per url. Each make has thousands XD 

I will work on fixing up the script.

Comment 8

[Chris DeCairos (:cade)]

https://gist.github.com/cadecairos/4b323796a8906d6bb765

Teh results from my updated script look much better!

Comment 9

[Chris DeCairos (:cade)]

Attachment: A helper script for getting remix metrics for makes

For future reference, this is the script I used to generate the remix metrics.

Comment 10

[Chris DeCairos (:cade)]

https://gist.github.com/cadecairos/8221548

Comment 11

[lainie]

Super helpful. Thank you!

Comment 12

[[github robot]]

Commit pushed to master at https://github.com/mozilla/makeapi-client

https://github.com/mozilla/makeapi-client/commit/5e72384efc85abfec5b3b4a59414a19b85470761
Bug 951761 - remixCount function and documentation

Comment 13

[[github robot]]

Commit pushed to master at https://github.com/mozilla/MakeAPI

https://github.com/mozilla/MakeAPI/commit/6dd68f61b3c09d85c992af949b8fe81871af558c
Bug 951761 - Add route remixCount route, Admin page support for remixCount

Comment 14

[[github robot]]

Commit pushed to master at https://github.com/mozilla/MakeAPI

https://github.com/mozilla/MakeAPI/commit/611c6fc2fc89ae9fe03048eca2bf857e51c8595c
Bug 951761 - Remix Count fixes for make admin page

Comment 15

[Chris DeCairos (:cade)]

This is on prod now, but I realized that the route can't count makes with > 10 remix results properly... a patch is on the way.

Comment 16

[Chris DeCairos (:cade)]

Attachment: https://github.com/mozilla/MakeAPI/pull/186

I've completely changed the way this works to make life easier. 

The previous approach I took got a list of remakes, and looped over them to check if the remix happened in a specific date range. 

This time, I extended the querybuilder so that it uses a remixedFrom filter and the all-new range filter to check the createdAt value. This method eliminates the need for any make data to be looped over as I can just return the total count of hits elasticsearch reports

Comment 17

[lainie]

Does this mean the numbers in comment #8 are no longer valid?

Comment 18

[Scott [:thecount] Downe]

@lainie I believe the numbers are still good. It looks like he just changed it to do the same thing faster and with less code to maintain.

Comment 19

[Scott [:thecount] Downe]

Comment on attachment 8355333 [details] [review]
https://github.com/mozilla/MakeAPI/pull/186

I like where you're going with this.

Some questions in the pull request.

Comment 20

[Chris DeCairos (:cade)]

(In reply to lainie from comment #17)
> Does this mean the numbers in comment #8 are no longer valid?

(In reply to Scott [:thecount] Downe from comment #18)
> @lainie I believe the numbers are still good. It looks like he just changed
> it to do the same thing faster and with less code to maintain.

Yes, The numbers are still valid, I just improved the way I get them.

Comment 21

[[github robot]]

Commit pushed to master at https://github.com/mozilla/MakeAPI

https://github.com/mozilla/MakeAPI/commit/19d987d7d805215d69ad6344240de69be7afc18d
Bug 951761 - Better method for counting remixes

Comment 22

[Chris DeCairos (:cade)]

All fixed! now you can find remix metrics for every make using a date range using the Make Editor.