658134 - Users with old versions of test pilot still submit data

Status: RESOLVED WONTFIX

(Mozilla Labs Graveyard :: Test Pilot, defect, P2)

Description

[Ed Lee :Mardak]

The search behavior study has minTPVersion to "1.1" but I see "empty" submissions with tpVersion: "1.0.4":

{"phase":0,"data":[{"metadata":{"extensions":[{"id":"665886a94fb0a04c1d50029cd4cc6c8718723a3d","isEnabled":true},{"id":"fdec30473c9ea30e50fb619ced110d989f366c82","isEnabled":false},{"id":"193aad79b85f1079b675e283ca2d84cd7380f795","isEnabled":false},{"id":"216ee7f7f4a5b8175374cd62150664efe2433a31","isEnabled":true}],"accessibilities":[{"name":"accessibility.mouse_focuses_formcontrol","value":false},{"name":"accessibility.browsewithcaret","value":false},{"name":"accessibility.typeaheadfind.startlinksonly","value":false},{"name":"accessibility.usebrailledisplay","value":""},{"name":"accessibility.typeaheadfind.timeout","value":5000},{"name":"accessibility.typeaheadfind.enabletimeout","value":true},{"name":"accessibility.tabfocus_applies_to_xul","value":true},{"name":"accessibility.typeaheadfind.flashBar","value":1},{"name":"accessibility.typeaheadfind.autostart","value":true},{"name":"accessibility.blockautorefresh","value":false},{"name":"accessibility.browsewithcaret_shortcut.enabled","value":true},{"name":"accessibility.typeaheadfind.enablesound","value":true},{"name":"accessibility.typeaheadfind.prefillwithselection","value":true},{"name":"accessibility.typeaheadfind.soundURL","value":"beep"},{"name":"accessibility.typeaheadfind","value":false},{"name":"accessibility.typeaheadfind.casesensitive","value":0},{"name":"accessibility.warn_on_browsewithcaret","value":true},{"name":"accessibility.usetexttospeech","value":""},{"name":"accessibility.typeaheadfind.linksonly","value":false},{"name":"accessibility.accesskeycausesactivation","value":true}],"location":"en-US","fxVersion":"4.0.1","operatingSystem":"Darwin Intel Mac OS X 10.5","tpVersion":"1.0.4","surveyAnswers":"","task_guid":"","event_headers":["key","value","timestamp"]},"events":[]}]}

Comment 1

[Jono Xia]

Maybe 1.0.4 didn't have the tpVersion check in it yet?

How many of these submissions are there?

Comment 3

[Ed Lee :Mardak]

Of the ~200 early submissions from the 2 hour study, there were these entries:

"location":"chrome://global/locale/intl.properties","fxVersion":"4.0.1","tpVersion":"1.0.6"
"location":"de","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"de","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"en-GB","fxVersion":"4.0.1","tpVersion":"1.0.6"
"location":"es-ES","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"es-ES","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"fr","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"fr","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"fr","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"fr","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"hu","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"pl","fxVersion":"4.0b11","tpVersion":"1.0.6"
"location":"pt-BR","fxVersion":"3.6.17","tpVersion":"1.0.2"
"location":"pt-BR","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"pt-BR","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"pt-BR","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"pt-BR","fxVersion":"4.0b8","tpVersion":"1.0.3"
"location":"pt-PT","fxVersion":"4.0","tpVersion":"1.0.6"
"location":"sk","fxVersion":"4.0b8","tpVersion":"1.0.3"

Perhaps resolved invalid unless there's a good way to prevent old versions from running the study from the study.

Comment 4

[Adam Muntner [:adamm] (use NEEDINFO)]

decommissioned