966207 - Ship a plan/tickets for testing how we're measuring web literacy

Status: RESOLVED INCOMPLETE

(Webmaker Graveyard :: Metrics, defect, P5)

Description

[Adam Lofting (:adamlofting)]

The pad:
https://etherpad.mozilla.org/webmaker-workweek-metrics-literacy

Comment 1

[Matt Thompson (@OpenMatt :OpenMatt)]

* Going through the huge number of tickets and work we've already put on our plates in the run-up to work week, I'm wondering how big a priority this actually is

* On the one hand, it seems crucial

* On the other, it seems impossible. And ripe for gaming or metrics that don't actually tell us anything that will make our product better.
 
* Curious to hear what you guys come up with. But just wanted to say: we're looking for things to cut. And this could be one of them?

Comment 2

[Adam Lofting (:adamlofting)]

Yep, this is an interesting one to me, but at best I'll be trying to bring my metrics experience to others' knowledge of teaching and learning.

I'm not sure who added the request to the original Etherpad (I think perhaps Doug?), but I wanted to support it if I could.

I'm not sure what the output of this would look like yet, but it would be good to get a few heads together while we're in the same space to start the conversations.

Comment 3

[Matt Thompson (@OpenMatt :OpenMatt)]

* I believe Michelle suggested this -- and it's an excellent suggestion. If we say we're all about increasing web literacy, it makes sense that we need to think about measuring that somehow. 

* So I don't want to close off any discussion prematurely -- at this point I'm just trying to triage. And suggest things we could potentially punt to post-workweek, cuz we've got a lot on.

Comment 4

[Brett Gaylor [:brett]]

I wonder if this should be something like "List of external qualitative factors we would use to gauge our impact?"

ie what are surveys or other instruments that might help us understand the state of web literacy in the world?  I'm thinking of something similar to the "health of the web" report that was shown at the last Mozilla summit:

http://www.youtube.com/watch?v=9A6eEjqVmQA

Comment 5

[[:dajbelshaw] Doug Belshaw]

+1 to Brett's suggestion of something like the 'Heath of the Web' report. Anything that doesn't give a single, summative 'number' on literacy sounds good. Approaching this by pointing to signals of our impact within the wider ecosystem sounds good.

Comment 6

[Adam Lofting (:adamlofting)]

I'm keeping this open as well but in the backlog for now. There could be something to do here with web lit badges and user profiles.

Comment 7

[[:dajbelshaw] Doug Belshaw]

As long as it's driven by qualitative feedback, it's all good. :-)

Comment 8

[Adam Lofting (:adamlofting)]

This is an ongoing important part of what we think about for Webmaker. But I don't think this ticket is where we need to do this :)

Comment 9

[[:dajbelshaw] Doug Belshaw]

Agreed - shall we move this to GitHub and have a meeting soon?