1111800 - [research] did frequency of email address in description drop?

Status: RESOLVED FIXED

(Input Graveyard :: Submission, defect)

Description

[Will Kahn-Greene [:willkg] ET needinfo? me]

We pushed out a brand new generic feedback form on November 26th. The new form moves the ask for the user's email address to right under the feedback description--it's no longer on the second page.

The theory is that the user would see that there was a field specifically for their email address and not put it in the description. Thus the frequency of "email address in description" would decrease.

This bug covers doing some analysis of before and after to determine whether our theory held true.

Comment 1

[Will Kahn-Greene [:willkg] ET needinfo? me]

Bumping to next quarter.

Comment 2

[Will Kahn-Greene [:willkg] ET needinfo? me]

I wrote a script to comb the data and we've got three kinds of responses that have email addresses in them:

1. spam where the entire description is an email address

2. responses that contain about:support data which has email addresses in the extension records

3. responses where the user puts their email address in either as a signature to their "letter" or asking us for assistance


I bring this up because item 2 suggests a case where having an email address in the description field is "valid" so we can't just deny submission if we see email addresses.

Going back to this bug, I don't see any noticeable reduction in email addresses before vs. after landing the new form for Firefox product (I didn't look at other products since they have other forms involved):

Day span:         30
Total before:     22427
Total with email: 206
Total just email: 21
Normalized total: 1.21227027027

Day span:         42
Total after:      29172
Total with email: 385
Total just email: 121
Normalized total: 1.105

normalized total is: total / ((with-email - just-email) * 100)


Closing this as FIXED.