Bug 1838501 Comment 2 Edit History

Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.

FWIW IanK is updating WPT tests to reflect this spec change, in https://github.com/web-platform-tests/wpt/pull/40710

If I'm not mistaken: those test changes make current Firefox Nightly newly fail ~27 interop-2023-relevant tests in the `css/css-grid/abspos` directory.

[details follow, for folks curious about metrics/score]

Results with the current test set: we pass 169.5 / 171 score-relevant tests in that directory:
https://wpt.fyi/results/css/css-grid/abspos?sha=2cf035c769&label=experimental&label=master&product=chrome&product=firefox&view=interop&q=label%3Ainterop-2021-grid%20or%20label%3Ainterop-2023-grid

Results with IanK's PR: we pass 28.57 / 57 of the tests in that directory (i.e. we fail 28.43 tests) -- note that not all of the tests were run, but of the ones that were, we fail 28.43 of them:
https://wpt.fyi/results/css/css-grid/abspos?sha=5fcd4da0c2&label=pr_head&label=experimental&product=chrome&product=firefox&view=interop&q=label%3Ainterop-2021-grid%20or%20label%3Ainterop-2023-grid

So that indicates that we're going from 1.5 test-failures in that directory to 28.43 test-failures, which represents 26.93 new test failures.  Assuming the total number of tests remains the same for the "grid" focus area (current total: 1043), these new test failures represent a 26.93 / 1043 = ~2.6% regression in our score for the grid focus area.
FWIW IanK is updating WPT tests to reflect this spec change, in https://github.com/web-platform-tests/wpt/pull/40710

If I'm not mistaken: those test changes make current Firefox Nightly newly fail ~27 interop-2023-relevant tests in the `css/css-grid/abspos` directory.

[details follow, for folks curious about metrics/score]

Results with the current test set: we pass 169.5 / 171 score-relevant tests in that directory:
https://wpt.fyi/results/css/css-grid/abspos?sha=2cf035c769&label=experimental&label=master&product=chrome&product=firefox&view=interop&q=label%3Ainterop-2021-grid%20or%20label%3Ainterop-2023-grid

Results with IanK's PR: we pass 28.57 / 57 of the tests in that directory (i.e. we fail 28.43 tests) -- note that not all of the tests were run, but of the ones that were, we fail 28.43 of them:
https://wpt.fyi/results/css/css-grid/abspos?sha=5fcd4da0c2&label=pr_head&label=experimental&product=chrome&product=firefox&view=interop&q=label%3Ainterop-2021-grid%20or%20label%3Ainterop-2023-grid

So that indicates that we're going from 1.5 test-failures in that directory to 28.43 test-failures, which represents 26.93 new test failures.  Assuming the total number of tests remains the same for the "grid" focus area (current total: 1043), these new test failures represent a 26.93 / 1043 = ~2.6% regression in our score for the grid focus area, which represents a ~0.1% regression in the overall top-level score (dividing 2.6% by 26 since there are 26 equally-weighted focus areas).

Back to Bug 1838501 Comment 2