Closed Bug 959727 Opened 10 years ago Closed 10 years ago

Create User Testing Kit for Appmaker

Categories

(Webmaker Graveyard :: General, defect)

Product:
Webmaker Graveyard
Component:
General
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 965417

People

(Reporter: kat, Assigned: kat)

References

Details

(Whiteboard: [crossteambugs] [copywriting] [workweek][workweek-codesign]) 

Concurrently to the creation of a community User Testing Kit for Webmaker, we need to create a Kitchen Table User Testing Kit for Appmaker in Brazil, to be launched by Campus Party in late January. 

Note: This is a piece of a larger 4-phase user testing/ethnography/co-design plan to determine local needs + wants in the region: https://docs.google.com/document/d/1z112nDze1Ln4LfXnErhB43AvFUOCfqbqYeba280FFys/edit?pli=1#heading=h.zf47aiopktw
Bug for Webmaker version of User Testing kit is here: https://bugzilla.mozilla.org/show_bug.cgi?id=959389
Whiteboard: [crossteambugs]
rad, thanks kat!
Here are some notes from three tests we performed via usertesting.com in November 2012:
https://docs.google.com/document/d/1BPFvW16bXvWPOI37I9Yv1fvL-ZrC7FrZHc4LH9nYoL0/edit?usp=sharing
OS: Mac OS X → All
Hardware: x86 → All
@ Luke: these are helpful -- thanks! 
* Can you say a little more about usertesting.com? How did you find it? Do you think we should consider using it more for Webmaker and Appmaker? 
* I'm also curious about the process you used for turning your notes into action -- filed as tickets, circulated on newsgroups, fodder for group discussion. How did you feel that part went? Trying to figure out how to make that process more agile for Webmaker.
Assignee: nobody → kat
Status: NEW → ASSIGNED
(In reply to Matt Thompson (@OpenMatt :OpenMatt) from comment #4)
> @ Luke: these are helpful -- thanks! 
> * Can you say a little more about usertesting.com? How did you find it? Do
> you think we should consider using it more for Webmaker and Appmaker? 
> * I'm also curious about the process you used for turning your notes into
> action -- filed as tickets, circulated on newsgroups, fodder for group
> discussion. How did you feel that part went? Trying to figure out how to
> make that process more agile for Webmaker.

Hey Matt - the Labs had used Usertesting.com in the past for other projects, although I wasn't around at the time so I can't comment on how effective it was. This first round of tests we ran was very helpful in identifying some problem areas with Appmaker and we plan on using it in the future. Part of the process also involves refining the tasks you ask people to perform - my first attempt left some users stuck in weird places.

So far we've only used the notes as a catalyst for some informal brainstorming, and haven't had a chance to change the product as a direct result of the tests. We use github issues right now to track to-dos and buts, so I imagine once we have the bandwidth to tackle some of our findings, the tasks will end up there.

Let me know if you have any other questions! I can also give you the credentials for our usertesting.com account if you want to poke around and see what the resulting videos look like!
I just talked to Kim Wilkens who runs Tech Girls (http://tech-girls.org), and she talked about wanting to do more with Appmaker. She said she'd be interested in beta testing/ user testing the user testing kit with girls in her community. I thought I'd make a FYI note for you and will email the bug to her :)
Cheers, Luke - thanks again for adding your insight here; is a great place for us to start from as we build out this kit. 

Other updates in addition to Laura's (which is awesome, by the way): 

* Karen and I have met re: creation of this, and I will draft the kit; meeting with Bobby tomorrow to finalise components and pathways to be included in testing kits for ReMo use at Campus Party Brazil.
* Will rename it to "Community Testing Kit" to differentiate between this and the (in-person, Mozilla facilitated) workshops happening in Toronto for Webmaker, and also to avoid conflating these experimental (participatory design/connected learning) methods with the established best practices of the MoCo UX/UR team. 
* We'll use Campus Party as the first use-case for how this can be executed in such a way that the community is empowered to hold their *own* Community Testing Kit sessions, and will integrate lessons/findings into the larger Brazil narrative for Appmaker within LAN centres. 

Yea!!
* Sweet! sounds like a great plan Kat. Let us know if we can help out with your draft in any way. And can you paste a link to your etherpad draft once you get started? So we can steal ideas and approaches for the other kit as well.
Matt et al, here is Community Testing Kit draft so far in GDoc form: https://docs.google.com/a/mozillafoundation.org/document/d/1RsPurd1awgTFBwWUtqsDJms2aPeCIEy_Yxp18zlPOeY/edit#

Please feel free to add comments/suggestions where we are missing things.
* Sweet -- how far along is this draft? Is it a completed first draft?
Kim here and I'm definitely interested in testing and getting my girls exposed to the testing process - so keep us posted!
Hey Kat, I commented and thought it was saved but they're gone now.  Did you see my comments about renaming some of the sections to try to think about what the test stage would be from a user's perspective, etc..

If yes and they're resolved for you, no worries.

If no, I'll re-do them.
Hi, Kim! Great to e-meet you. And thank you for the kind offer! We'd definitely like to work together. 

Matt: Not completed; waiting for details from Bobby and team re: components and testing methods they want to focus on.

Karen: No comments :( Under your gmail account you should be able to both comment and edit; let me know if you'd like me to re-add you?
I started my re-commenting.  I'll finish it tomorrow.
Whiteboard: [crossteambugs] → [crossteambugs] [copywriting]
Summary: Create Kitchen Table User Testing Kit for Appmaker → Create User Testing Kit for Appmaker
Note: This moved to backburner as longer-term project (to be ready when we go to Rio instead). Quicker usability test ported here: https://bugzilla.mozilla.org/show_bug.cgi?id=959727
Depends on: 963871
Whiteboard: [crossteambugs] [copywriting] → [crossteambugs] [copywriting] [workweek]
Whiteboard: [crossteambugs] [copywriting] [workweek] → [crossteambugs] [copywriting] [workweek][workweek-codesign]
Status: ASSIGNED → RESOLVED
Closed: 10 years ago
Resolution: --- → DUPLICATE
Component: Community → General
You need to log in before you can comment on or make changes to this bug.