Closed Bug 2029364 Opened 3 months ago Closed 2 months ago

[wpt-sync] Sync PR 58975 - [focusgroup] Split behavior-tokens-comprehensive into per-token tests

Categories

(Core :: DOM: Core & HTML, task, P4)

Product:
Core
Component:
DOM: Core & HTML
Type:
task

Tracking

()

Status:
RESOLVED FIXED
Milestone:
151 Branch
Tracking Flags:
Tracking Status
firefox151 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 58975 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/58975
Details from upstream follow.

Jacques Newman <janewman@microsoft.com> wrote:

[focusgroup] Split behavior-tokens-comprehensive into per-token tests

behavior-tokens-comprehensive.html had many promise_tests doing
WebDriver round-trips via focusAndKeyPress(). On some CI bots this
exceeded the default WPT timeout, causing the flakiness.

This CL splits the file into individual tests under behavior-tokens/,
one per behavior token plus an overrides file. Each file has a few
tests, and should be well within the default timeout.

This CL also removes the TestExpectations timeout entry added by the
gardener in crrev.com/c/7702976.

Bug: 489128050, 40210717
Change-Id: If670207b6b5ee690ca92113d22f818140597efc9
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/7721920
Reviewed-by: Mason Freed \<masonf@chromium.org>
Commit-Queue: Jacques Newman \<janewman@microsoft.com>
Cr-Commit-Position: refs/heads/main@{#1609866}

PR 58975 applied with additional changes from upstream: a5e556c6288a4fadbe8b8fc2fc7840cd757f90bf
Component: web-platform-tests → DOM: Core & HTML
Product: Testing → Core

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 8 tests and 10 subtests

Status Summary

Firefox

OK : 8
PASS: 35
FAIL: 48

Chrome

OK : 8
PASS: 83

Safari

OK : 8
PASS: 35
FAIL: 48

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /html/interaction/focus/focusgroup/tentative/behavior-tokens/grid.html [wpt.fyi]
    • grid: ArrowRight moves to next column: FAIL (Chrome: PASS, Safari: FAIL)
    • grid: ArrowLeft moves to previous column: FAIL (Chrome: PASS, Safari: FAIL)
    • grid: ArrowDown moves to same column next row: FAIL (Chrome: PASS, Safari: FAIL)
    • grid: ArrowUp moves to same column previous row: FAIL (Chrome: PASS, Safari: FAIL)
  • /html/interaction/focus/focusgroup/tentative/behavior-tokens/listbox.html [wpt.fyi]
    • listbox: ArrowDown navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • listbox: ArrowUp navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
    • listbox wrap: ArrowDown navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • listbox wrap: ArrowDown wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • listbox wrap: ArrowUp wraps at start: FAIL (Chrome: PASS, Safari: FAIL)
  • /html/interaction/focus/focusgroup/tentative/behavior-tokens/menu.html [wpt.fyi]
    • menu: ArrowDown navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • menu: ArrowUp navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
    • menu: ArrowDown wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • menu: ArrowUp wraps at start: FAIL (Chrome: PASS, Safari: FAIL)
    • menu inline: ArrowRight navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • menu inline: ArrowLeft navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
    • menu inline: ArrowRight wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • menu inline: ArrowLeft wraps at start: FAIL (Chrome: PASS, Safari: FAIL)
    • menu nowrap: ArrowDown navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
  • /html/interaction/focus/focusgroup/tentative/behavior-tokens/menubar.html [wpt.fyi]
    • menubar: ArrowRight navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • menubar: ArrowLeft navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
    • menubar: ArrowRight wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • menubar: ArrowLeft wraps at start: FAIL (Chrome: PASS, Safari: FAIL)
  • /html/interaction/focus/focusgroup/tentative/behavior-tokens/radiogroup.html [wpt.fyi]
    • radiogroup: ArrowRight navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup: ArrowLeft navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup: ArrowDown navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup: ArrowUp navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup: ArrowRight wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup: ArrowLeft wraps at start: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup: ArrowDown wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup: ArrowUp wraps at start: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup inline: ArrowRight navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup inline: ArrowRight wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • radiogroup nowrap: ArrowRight navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
  • /html/interaction/focus/focusgroup/tentative/behavior-tokens/tablist.html [wpt.fyi]
    • tablist: ArrowRight navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • tablist: ArrowLeft navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
    • tablist: ArrowRight wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • tablist: ArrowLeft wraps at start: FAIL (Chrome: PASS, Safari: FAIL)
    • tablist block: ArrowDown navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • tablist block: ArrowUp navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
    • tablist block: ArrowDown wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • tablist block: ArrowUp wraps at start: FAIL (Chrome: PASS, Safari: FAIL)
    • tablist nowrap: ArrowRight navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • tablist nowrap: ArrowLeft navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
  • /html/interaction/focus/focusgroup/tentative/behavior-tokens/toolbar.html [wpt.fyi]
    • toolbar: ArrowRight navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • toolbar: ArrowLeft navigates to the previous item: FAIL (Chrome: PASS, Safari: FAIL)
    • toolbar wrap: ArrowRight navigates to the next item: FAIL (Chrome: PASS, Safari: FAIL)
    • toolbar wrap: ArrowRight wraps at end: FAIL (Chrome: PASS, Safari: FAIL)
    • toolbar wrap: ArrowLeft wraps at start: FAIL (Chrome: PASS, Safari: FAIL)

https://hg.mozilla.org/mozilla-central/rev/79f5a50d14e6
https://hg.mozilla.org/mozilla-central/rev/b4510cf290a3

Status: NEW → RESOLVED
Closed: 2 months ago
status-firefox151: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 151 Branch
You need to log in before you can comment on or make changes to this bug.