bugzilla.mozilla.org has resumed normal operation. Attachments prior to 2014 will be unavailable for a few days. This is tracked in Bug 1475801.
Please report any other irregularities here.

Create quick user test for Appmaker at Campus Party

RESOLVED FIXED

Status

Webmaker
General
RESOLVED FIXED
5 years ago
5 years ago

People

(Reporter: codekat, Assigned: codekat)

Tracking

Details

(Whiteboard: [crossteambugs])

(Assignee)

Description

5 years ago
Task: Create quick + easy user test (usability focus) for Appmaker communities in Brazil in time for Campus Party.

* Will be translated into Portuguese
* Include a few questions about cultural context
* Focus on remix + components
* Allow for variety of skill levels
(Assignee)

Updated

5 years ago
Assignee: nobody → kat
(Assignee)

Comment 1

5 years ago
Note: In prog here; currently getting feedback from Appmaker team; to be translated this weekend (have other edits? please leave comments within!) 

https://docs.google.com/a/mozillafoundation.org/forms/d/16Qyz8oHl_RwMV-cdtwxHyVlamg0IDg5s4NOjYdMznv0/edit#
(Assignee)

Updated

5 years ago
Whiteboard: crossteambugs
(Assignee)

Comment 2

5 years ago
Note: Related to longer-term Community Testing Kit (ignore title of this bug, is outdated). https://bugzilla.mozilla.org/show_bug.cgi?id=959727 This kit to be released later, in Rio.
Whiteboard: crossteambugs → [crossteambugs]
(Assignee)

Updated

5 years ago
Blocks: 959727

Comment 3

5 years ago
 Screen 1 of survey: 
- Overall, it looks good.  I would add a line of instructions that read: 
If you get lost or stuck during this survey, let us know in the response box.  If any task is difficult for you, we suggest you spend a couple of minutes trying to figure it out and then feel free to move on.  

Screen 2 of survey / Part 1: Initial Interactions

I would add a line a few instructions at the top.
As before, if you get stuck or confused while trying out AppMaker, let us know in the response box.  If any task on this screen is taking you more than 2 minutes, you may want to move on to the next step.   

For the prompt:
Now, hit the orange "Remix" icon. Did you find it easy or difficult to find? 
-Even though there is really only one orange feature on the page, it is tiny.  I would change the prompt to direct users to the bottom of the page and merge with the next prompt: 
How do you think the "Remix" icon would work for beginners? 

Part II: Customizing and Experimenting

I would add a line a few instructions at the top.
As before, if you get stuck or confused while trying out AppMaker, let us know in the response box.  If any task on this screen is taking you more than 5 minutes, you may want to move on to the next step.   

I would add an additional question field under let’s browse:
What do you think components listed on the left of the screen are for?  How would you describe them? 
[insert an open ended field here]
(Assignee)

Comment 4

5 years ago
Awesome feedback, thanks Karen. Wanted to keep things as short as possible, but these edits do make sense (we don't want people to get lost or frustrated!). And very much in agreement re: vagueness of "Remix" icon. Will change wording to reflect your point.
+1 on the rewording of the remix, that was one of my comments too. I don't know if these are helpful, feel free to ignore! I went through it as an Appmaker n00b.

1. You’re right on the money with the timing, it took me 17 minutes to get through.

2. I feel like this is speaking to conflicting audiences. On the one hand I feel like you’re addressing me as a newbie to Appmaker and on the other it feels like I should be a pro at Appmaker. The use of the word “beginner” is strange - as if I’m definitely not one. And this statement: "If these questions are hard to answer, tell us how this feature could be better” makes me feel like I’m definitely a beginner, but I should have ideas about what I need.

3. The last statement: "Lastly (thank you again!) let's reflect on the steps you just went through. What could we add to the Appmaker "remix", "connect" and "make" process to make it easier for beginners?” <-- I’m not sure how this process is reflected in either the form or the app itself?

I agree with Karen that some gentle language explaining what user testing is a little is probably helpful for folks. Just give a little more encouragement for people so that even if they are frustrated with Appmaker, they can write about it in a helpful way.
(Assignee)

Comment 6

5 years ago
Thanks for moar feedback, Laura and Cassie! Changing things to reflect your (very wise!) suggestions today.
(Assignee)

Comment 7

5 years ago
Now edited. Major changes are adding more clues throughout process, changing remix wording, embedding video, and making more friendly for folks who may (or may not!) identify as beginners...

Thanks again, guys.

Comment 8

5 years ago
Awesome work—maybe worth pinging Luke Aali and company to see about updating the Portuguese translation with these changes. They should have the link.

Rad!
(Assignee)

Comment 9

5 years ago
Done and done :) Usability test now online; will be added to UserTesting.com system presently.
(Assignee)

Updated

5 years ago
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED
Component: Community → General
Product: Webmaker → Webmaker
You need to log in before you can comment on or make changes to this bug.