Closed Bug 959389 Opened 12 years ago Closed 12 years ago

Create a user testing kit for Webmaker

Categories

(Webmaker Graveyard :: General, defect)

Product:
Webmaker Graveyard
Component:
General
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 965417

People

(Reporter: matt, Unassigned)

Details

(Whiteboard: [crossteambugs] [copywriting][workweek-codesign][workweek])

* Similar to our current event guides, focused on walking users through the steps required to host their own Webmaker user testing session * Let's start a draft here: https://etherpad.mozilla.org/User-Testing-Kit * We can document and include key learnings from the prototype user testing event happening Jan 24 https://bugzilla.mozilla.org/show_bug.cgi?id=943959
Summary: Create a user testing guide for Webmaker → Create a user testing kit for Webmaker
Hey, guys. Adding myself in here at behest of Ben to customise above model for Appmaker/Brasil context. Karen, where are you on this - could we perhaps have a chat this week to discuss? :)
Flags: needinfo?(karen.louise.smith)
I just blogged about this here: http://mzl.la/user_testing * Includes key calls to action, ways to get involved, and next steps * @ Kat: we're just getting started on this. Nothing's been written or collected yet. If you have ideas or resources, we'll write the draft in the open here: https://etherpad.mozilla.org/User-Testing-Kit * I'm going to try and add some key points around "do it yourself" usability testing from Steve Krug's "Don't Make Me Think" later this week: http://www.amazon.ca/Dont-Make-Me-Think-Usability/dp/0321344758
Flags: needinfo?(karen.louise.smith)
And cheers, Matt. Let's work together on this so I can build out for Appmaker too. I have a lot of user testing/co-design resources we can use from above bug also, to help guide process!
Thanks Kat. And thanks for adding that stuff to the Webmaker User Testing Kit draft: https://etherpad.mozilla.org/User-Testing-Kit
http://usertesting.com/ looks interesting....
http://usertesting.com/ looks good!
http://usertesting.com/ seems pretty good. I just applied to be a tester, to see the process of how a website will be tested. And its pretty straight forward. From a user/tester's point of view: 1) The user is first given a mindset at which to use the website. 2) with that mindset, the user is given some tasks to perform on the website. 3) While performing those tasks, the user's screen is recorded as he sets about doing his task and he is also asked to say what he is thinking while he is performing that task. 4) He is then asked to write some answers based on what he thinks, and the questions can be anything since they are provided by the website being tested. The whole video is given to the website, and then they can see the real-time effects while the user is using their website. IMO, it can be used as an extra test result as it can give some valuable feedback but not THE test we want to use. So I think we need that Testing Kit.
User research folks from MoCo previously raised some issues about how data can be used if collected via commercial 3rd party services. There are limitations based on the user and tester agreements and Cassie and I were advised that blogging about results may not be allowable. Important stuff to check into before using any 3rd party tool.
Great point Karen -- thanks for that.
* Thanks for this daft.goon * what's nice about the process you're describing is it seems like a great additional pathway for inviting users to test *online,* on their own, instead of having to attend these in-person meetings. * That would be a great additional pathway to build -- provided we can address Karen's points around privacy. Interesting...
Hi All, This bug was just brought to my attention this morning, since I was one of the members of the MoCo UX team that had a hand in closing our recent deal with Usertesting.com (tl;dr we have an enterprise account with them and use Usertesting.com for a lot of the MoCo products) While we don't have issues with using the videos and results in blogs and other publications (the participants agree to our release before starting any test they participate in for us and this is allowed by the Usertesting.com terms of service) from the blog post, testing with the panel doesn't sound like what your goal for this is, because it isn't really working with the community. Tests with Usertesting.com come up for the whole 3+ million participant panel and quickly disappear as people grab open spots in the tests, this is why studies run on Usertesting.com close so fast (We had one in December close in 15 mins.) Because of this, it may not be a great way for community members already involved with the project to be able to test online, but it may be a great way to get more people to join the community by testing it and finding out that Webmaker exists via Usertesting.com. To that end, if you'd like a demo, or to run a demo test, I would be more than happy to work with you guys to set that up. If I'm understanding the blog post correctly, it sounds like you guys are trying to build a participatory design toolkit that anyone can use, which is really exciting! I've posted some other notes about that into the etherpad. I'd love to be able to help in this effort in anyway I can :)
(In reply to Tony Santos [:tsmuse] from comment #12) > Hi All, Thanks Tony. Super helpful context. > To that end, if you'd like a demo, or to run a demo test, I would be more than happy to work > with you guys to set that up. We'd love that. Just sent you a calendar request. > It sounds like you guys are trying to build a participatory design toolkit that anyone can use, which is > really exciting! I've posted some other notes about that into the etherpad. > I'd love to be able to help in this effort in anyway I can :) That is indeed the goal! Thanks for adding that IDEO link to the pad.
Whiteboard: [crossteambugs] → [crossteambugs] [copywriting]
Whiteboard: [crossteambugs] [copywriting] → [crossteambugs] [copywriting][workweek-codesign][workweek]
@ Who are we assigning this ticket to? * Who is on the hook to actually sit down and *write* the first draft of this? * Karen: if it's you, can you assign it to yourself?
Assignee: matt → nobody
Flags: needinfo?(karen.louise.smith)
Matt, we're both in charge of this, but it's changed theme and direction. Please see bug 965417 for most recent updates.
Flags: needinfo?(karen.louise.smith)
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → DUPLICATE
* Hey Kat -- is this ticket really a duplicate of bug 965417? * That one is about making a plan. This one is about making a kit. For user testing events. Similar to our existing guides: https://webmaker.org/en-US/event-guides * I think we're close to being able to ship a Webmaker user testing kit. It just needs someone to complete a draft. What do you think?
matt, we've moved all conversation to https://bugzilla.mozilla.org/show_bug.cgi?id=965417 for both Webmaker AND Appmaker, to keep things less confusing and cross-bug. Please refer there! Thanks :)
Component: Community → General
You need to log in before you can comment on or make changes to this bug.