Running the shopify applink startup test locally, i.e. `cvne-shopify.sh`, I'm seeing a handful of fast outliers with incorrect timings. Plotted here https://zingy-sorbet-48e9a5.netlify.app/compare.html When I look at the associated videos, they do not match the reported timings. e.g. for the video attached, the reported time to completion was `1465.42222222222ms` Seeing this for 4 videos of the 200 iterations (increasing the number of iterations to get statistically significant results)
Bug 1972093 Comment 0 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
Running the shopify applink startup test locally, i.e. `cvne-shopify.sh`, I'm seeing a handful of fast outliers with incorrect timings. Plotted here https://zingy-sorbet-48e9a5.netlify.app/compare.html When I look at the associated videos, they do not match the reported timings. e.g. for the video attached, the reported time to completion was `1465.42222222222ms`, from the `baseline_h2` test run. Seeing this for 4 videos of the 200 iterations (increasing the number of iterations to get statistically significant results)