1253349 - QA Request: Hand-Test screen draw performance addon

Status: VERIFIED FIXED

(Shield :: General, defect)

Description

[Gregg Lind (Fx Strategy and Insights - Shield - Heartbeat )]

## Url for test plan:

https://github.com/gregglind/shield-variations-gestalt/blob/master/x-addon/full_test_plan.md

## Addon:

http://people.mozilla.org/~glind/all/shield-variations-demo-site/x-screen-draw-performance-variations-1.xpi

Comment 1

[Chris Hartjes [:grumpy][:chartjes]]

==========
TEST RESULTS
==========

Test conducted on Firefox 44.0.2 using plugin located at:

http://people.mozilla.org/~glind/all/shield-variations-demo-site/x-screen-draw-performance-variations-1.xpi

----------
TEST PREP
----------

- went to about:config, set general.warnOnAboutConfig to false
- verified in about:addons that plugin not installed

----------
TEST #1 - Install addon, normal install
----------

Installed Addon by downloading and manually installing via file

[e-mail] has value of 1457031232000
[e-mail] set to medium

Uninstalled addon
Survey tab created after addon removed

PASS

----------
TEST #2 - Install Addon, set browser to ineligible
----------
Set `nglayout.initialpaint.delay` to 13
Install addon

Addon installed, should not have worked.

FAIL - preference not available without addon being installed

----------
TEST #3: Setup a particular arm, startup
----------
Install addon
Set `nglayout.initialpaint.delay` to 0
Set `[e-mail]` to 'medium'
Restarted Firefox
Verified `nglayout.initialpaint.delay` was set to 50

Uninstall the addon

PASS

----------
TEST #4: End of study
----------

Set `nglayout.initialpaint.delay` to 0
Set `[e-mail]` to 500
Install addon

Verify Addon installs
Verify Addon immediately dies because it's too old
Verify observer survey opened with reason=end-of-study in the URL
Verify all extensions.@x-screen preferences where cleared

FAILED. `nglayout.initialpaint.delay` value not available in preferences without addon installed

----------
TEST #5 - 'user-disable'
----------

Prep - No addon installed

Set `nglayout.initialpaint.delay` to 0
Install addon
Disable addon

Verify survey opened
Verify all `extension.@x-screen` preferences have been cleared
Close Survery tab

FAILED. `nglayout.initialpaint.delay` value not available in preferences with addon installed

Comment 2

[Gregg Lind (Fx Strategy and Insights - Shield - Heartbeat )]

Revised test plan and addon (v.0.0.21).

I have hand-tested it, seems to fulfull the tests.

Comment 3

[Gregg Lind (Fx Strategy and Insights - Shield - Heartbeat )]

Revised test plan v.3 of plan, v.0.0.22 of addon.

https://github.com/gregglind/shield-variations-gestalt/blob/master/x-addon/full_test_plan.md

Thanks!

Comment 4

[Chris Hartjes [:grumpy][:chartjes]]

Successfully tested. QA approved.