Open Bug 1743116 Opened 4 years ago Updated 5 days ago

[meta] wdspec test meta data cleanup

Categories

(Remote Protocol :: Marionette, task)

Product:
Remote Protocol
Component:
Marionette
Type:
task

Tracking

(Not tracked)

People

(Reporter: whimboo, Unassigned)

References

(Depends on 14 open bugs)

Details

(Keywords: meta)

User Story

Gecko Meta Data:
================
Remote Protocol :: Marionette: 
https://jgraham.github.io/wptdash/?bugComponent=remote+protocol%3A%3Amarionette&tab=Gecko+Data

Remote Protocol :: WebDriver BiDi:
https://jgraham.github.io/wptdash/?bugComponent=remote+protocol%3A%3Awebdriver+bidi&tab=Gecko+Data

Command to retrieve all multiple statuses: 
`grep -r ': \[' testing/web-platform/meta/webdriver testing/web-platform/mozilla/meta/webdriver | grep -vE '(allowed: \[|threshold: \[)''

Meta bug to track all the work in keeping our wdspec test meta data clean and mostly free from multiple statuses.

Depends on: 1743117
Depends on: 1743352
Depends on: 1749256

With the WebDriver BiDi protocol being enabled by default on release channels soon we will get quite a good number of meta entry removals.

Depends on: 1753997

Bug 1506782 needs to be listed here as well because it adds support for opening new tabs on Android and this is currently the most used disable meta entry in our wdspec tests. Same applies for bug 1762164 which handles the KeyError for binary but only occurs in some tests.

Depends on: 1506782, 1762164
Depends on: 1766314
Depends on: 1762066
Depends on: 1602701
Depends on: 1777689
Depends on: 1792688
No longer depends on: 1792688
Depends on: 1791736
Depends on: 1485598
Depends on: 1563251
Depends on: 1563248
Depends on: 1744927
Depends on: 1793832
Depends on: 1793835
Depends on: 1793838
Depends on: 1793844
Depends on: 1793845
Depends on: 1795327
Depends on: 1806999
Depends on: 1808709
Component: geckodriver → Marionette
Product: Testing → Remote Protocol
Version: unspecified → Trunk
Summary: [meta] wdspec test meta data cleanup → [meta] WebDriver classic test meta data cleanup
Summary: [meta] WebDriver classic test meta data cleanup → [meta] WebDriver test meta data cleanup
Summary: [meta] WebDriver test meta data cleanup → [meta] wdspec test meta data cleanup
Depends on: 1838368
Depends on: 1839956
No longer depends on: 1762164
Depends on: 1846740
Depends on: 1846744
Depends on: 1847578
Depends on: 1849672
Depends on: 1855905
Depends on: 1863687
Depends on: 1857961
Depends on: 1864644
Depends on: 1864871
Depends on: 1802198
Depends on: 1873628
Depends on: 1875086
Depends on: 1865381
Depends on: 1879556
Depends on: 1785377
Depends on: 1886382
Depends on: 1894681
Depends on: 1894719
Depends on: 1913696

After not having cleaned-up multiple statuses for a while I pushed a new try build to see how many manifest entries we can actually remove:
https://treeherder.mozilla.org/jobs?repo=try&revision=fa2182d75f81fd87b3801e7b48ef106af6125f3c

URL: https://jgraham.github.io/wptdash/?bu...
User Story: (updated)
User Story: (updated)
User Story: (updated)

By accident I only pushed the jobs for Linux. So I did another try push now:
https://treeherder.mozilla.org/jobs?repo=try&revision=2bb757bf5e29e63c43b8eddbf0156711d76043f2

Depends on: 1920573

(In reply to Henrik Skupin [:whimboo][⌚️UTC+2] from comment #4)

By accident I only pushed the jobs for Linux. So I did another try push now:
https://treeherder.mozilla.org/jobs?repo=try&revision=2bb757bf5e29e63c43b8eddbf0156711d76043f2

This looks great, so I filed bug 1920573 to get all the multiple statuses removed for wdspec tests.

Depends on: 1930090
Depends on: 1930162
Depends on: 1865124
Depends on: 1894213
Depends on: 1962306
Depends on: 1965465
User Story: (updated)
User Story: (updated)
Depends on: 1983311
Depends on: 1983317
You need to log in before you can comment on or make changes to this bug.