Open Bug 2008355 Opened 10 hours ago Updated 4 hours ago

Consider enabling trackingProtection and safebrowsing in Browsertime pageload tests

Categories

(Testing :: Raptor, task)

task

Tracking

(Not tracked)

People

(Reporter: acreskey, Unassigned)

References

Details

As far as I can tell, both TrackingProtection and Safebrowsing are disabled in our CI Browsertime pageload tests
https://github.com/sitespeedio/browsertime/blob/fd66684edf12d7e879ad6c6703e189219dde7f9f/lib/support/cli.js#L586-L597
(Although the configuration options are complex, and they could be re-enable via some other mechanism).

In bug 2008101 we discovered a major longstanding performance issue in Fenix in which tracking protection options were misconfigured.

It would be helpful to be able to detect improvements and regressions in this area, but we would have to enable tracking protection and safebrowsing in a realistic manner in CI.
Note that initially these were disabled by Peter H due to noise issues.

Related bugs:
bug 1572713
bug 1599508

Browsertime options:
https://github.com/sitespeedio/browsertime/issues/1211

In-tree disablement of safebrowsing in perf profile:
https://searchfox.org/firefox-main/rev/b82cded8c5b732c2ea15b7871d14e13b5fadeffd/testing/profiles/perf/user.js#17-29

See Also: → 2008101, 1572713, 1599508

I tried to run local browsertime tests passing in the options to not disable safebrowsing and tracking protection

--firefox.disableSafeBrowsing false 
--firefox.disableTrackingProtection false 

However I was still not able to reproduce the behaviour that I see in Fenix outside of browsertime.

Fenix Nightly
https://share.firefox.dev/4q4jRhu
Note all the tailed requests and the 5-6 second delays on them

Fenix Nightly, via browsertime
https://share.firefox.dev/3L7xnlb
Note the lack of tailed requests and no 5-6 second delays

You need to log in before you can comment on or make changes to this bug.