On a test of lives sites in Fenix, we see statistically significant improvements to the time spent blocking channels during classification: Looking at the new Perfstat, UrlClassifierCheckChannel (baseline → defer_annotation, median ms) | Site | Baseline | defer_annotation | Δ | Significant | |---|---|---|---|---| | bing obama | 781 | 2 | −99.7% | yes (p=0.0000) | | bing restaurants | 590 | 2 | −99.7% | yes (p=0.0000) | | ikea | 420 | 7 | −98.3% | yes (p=0.0000) | | ikea outdoor | 2563 | 233 | −90.9% | yes (p=0.0000) | | en.wikipedia Elvis | 43 | 6 | −86.0% | yes (p=0.0000) | | wiki Mozilla | 49 | 11 | −77.6% | yes (p=0.0000) | | cnn | 47 | 11 | −76.3% | yes (p=0.0000) | | bild.de_ | 817 | 473 | −42.2% | yes (p=0.0000) | | bild royals article | 369 | 408 | +10.7% | no (p=0.47) | From the 9 urls that I checked, we picked up significant and reproduced improvements to a wikipedia page: https://en.wikipedia.org/wiki/Elvis_Presley en.wikipedia (Elvis)** — coherent across the whole set: | Metric | Baseline | defer_annotation | Δ | p | |---|---|---|---|---| | SpeedIndex | 1259 | 1237 | −1.7% | 0.0127 | | ContentfulSpeedIndex | 886 | 856 | −3.4% | 0.0204 | | PerceptualSpeedIndex | 1340 | 1298 | −3.1% | 0.0047 | | FirstVisualChange | 848 | 799 | −5.7% | 0.0111 | | LastVisualChange | 1724 | 1659 | −3.8% | 0.0138 | | VisualComplete85 | 1615 | 1566 | −3.0% | 0.0075 | | VisualComplete95 | 1704 | 1633 | −4.2% | 0.0048 | | FCP | 826 | 772 | −6.5% | 0.0189 | | LCP renderTime | 826 | 780 | −5.6% | 0.0304 | All metrics reported here in [google sheets](https://docs.google.com/spreadsheets/d/1Q21UFjRw8t25-oxen0cRkNubdvB67gAN7kCLtturcGo/edit?gid=804302687#gid=804302687&range=522:522).
Bug 2030021 Comment 38 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
On a test of lives sites in Fenix, we see statistically significant improvements to the time spent blocking channels during classification: Looking at the new Perfstat, UrlClassifierCheckChannel (baseline → defer_annotation, median ms) | Site | Baseline | defer_annotation | Δ | Significant | |---|---|---|---|---| | bing obama | 781 | 2 | −99.7% | yes (p=0.0000) | | bing restaurants | 590 | 2 | −99.7% | yes (p=0.0000) | | ikea | 420 | 7 | −98.3% | yes (p=0.0000) | | ikea outdoor | 2563 | 233 | −90.9% | yes (p=0.0000) | | en.wikipedia Elvis | 43 | 6 | −86.0% | yes (p=0.0000) | | wiki Mozilla | 49 | 11 | −77.6% | yes (p=0.0000) | | cnn | 47 | 11 | −76.3% | yes (p=0.0000) | | bild.de_ | 817 | 473 | −42.2% | yes (p=0.0000) | | bild royals article | 369 | 408 | +10.7% | no (p=0.47) | From the 9 urls that I checked, we picked up significant and reproduced improvements to a wikipedia page: https://en.wikipedia.org/wiki/Elvis_Presley en.wikipedia (Elvis) | Metric | Baseline | defer_annotation | Δ | p | |---|---|---|---|---| | SpeedIndex | 1259 | 1237 | −1.7% | 0.0127 | | ContentfulSpeedIndex | 886 | 856 | −3.4% | 0.0204 | | PerceptualSpeedIndex | 1340 | 1298 | −3.1% | 0.0047 | | FirstVisualChange | 848 | 799 | −5.7% | 0.0111 | | LastVisualChange | 1724 | 1659 | −3.8% | 0.0138 | | VisualComplete85 | 1615 | 1566 | −3.0% | 0.0075 | | VisualComplete95 | 1704 | 1633 | −4.2% | 0.0048 | | FCP | 826 | 772 | −6.5% | 0.0189 | | LCP renderTime | 826 | 780 | −5.6% | 0.0304 | All metrics reported here in [google sheets](https://docs.google.com/spreadsheets/d/1Q21UFjRw8t25-oxen0cRkNubdvB67gAN7kCLtturcGo/edit?gid=804302687#gid=804302687&range=522:522).