Consider enabling trackingProtection and safebrowsing in Browsertime pageload tests
Categories
(Testing :: Raptor, task)
Tracking
(Not tracked)
People
(Reporter: acreskey, Unassigned)
References
Details
As far as I can tell, both TrackingProtection and Safebrowsing are disabled in our CI Browsertime pageload tests
https://github.com/sitespeedio/browsertime/blob/fd66684edf12d7e879ad6c6703e189219dde7f9f/lib/support/cli.js#L586-L597
(Although the configuration options are complex, and they could be re-enable via some other mechanism).
In bug 2008101 we discovered a major longstanding performance issue in Fenix in which tracking protection options were misconfigured.
It would be helpful to be able to detect improvements and regressions in this area, but we would have to enable tracking protection and safebrowsing in a realistic manner in CI.
Note that initially these were disabled by Peter H due to noise issues.
Related bugs:
bug 1572713
bug 1599508
Browsertime options:
https://github.com/sitespeedio/browsertime/issues/1211
In-tree disablement of safebrowsing in perf profile:
https://searchfox.org/firefox-main/rev/b82cded8c5b732c2ea15b7871d14e13b5fadeffd/testing/profiles/perf/user.js#17-29
| Reporter | ||
Updated•10 hours ago
|
| Reporter | ||
Comment 1•7 hours ago
|
||
I tried to run local browsertime tests passing in the options to not disable safebrowsing and tracking protection
--firefox.disableSafeBrowsing false
--firefox.disableTrackingProtection false
However I was still not able to reproduce the behaviour that I see in Fenix outside of browsertime.
Fenix Nightly
https://share.firefox.dev/4q4jRhu
Note all the tailed requests and the 5-6 second delays on them
Fenix Nightly, via browsertime
https://share.firefox.dev/3L7xnlb
Note the lack of tailed requests and no 5-6 second delays
Description
•