[wpt-sync] Sync PR 48289 - FLEDGE: WPT verification of B&A component auctions...
Categories
(Testing :: web-platform-tests, task, P4)
Tracking
(firefox132 fixed)
Tracking | Status | |
---|---|---|
firefox132 | --- | fixed |
People
(Reporter: wpt-sync, Unassigned)
References
()
Details
(Whiteboard: [wptsync downstream])
Sync web-platform-tests PR 48289 into mozilla-central (this bug is closed when the sync is complete).
PR: https://github.com/web-platform-tests/wpt/pull/48289
Details from upstream follow.
Maks Orlovich <morlovich@chromium.org> wrote:
FLEDGE: WPT verification of B&A component auctions...
...and also various bid fields that are observable from them at
top-level auction level.Change-Id: I5ad605a8c9c21563f97dbb8155d9805205f73f80
Reviewed-on: https://chromium-review.googlesource.com/5872540
WPT-Export-Revision: 6fdfc4c5773c5b093dc89b037949593317e5509e
Assignee | ||
Comment 1•1 month ago
|
||
Assignee | ||
Comment 2•1 month ago
|
||
Assignee | ||
Comment 3•1 month ago
|
||
CI Results
Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI
Total 12 tests and 4 subtests
Status Summary
Firefox
OK
: 12
FAIL
: 48
Chrome
OK
: 12
FAIL
: 48
Safari
OK
: 12
FAIL
: 48
Links
Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base
Details
New Tests That Don't Pass
- /fledge/tentative/server-response.https.window.html?37-40 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction - invalid ad currency:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - valid ad currency:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction --- missing top-level seller:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction --- wrong top-level seller:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction - invalid ad currency:
- /fledge/tentative/server-response.https.window.html?21-24 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction - negative bid is bad:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - zero bid is bad:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - winning group did not bid:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - negative bidding group index:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction - negative bid is bad:
- /fledge/tentative/server-response.https.window.html?41-44 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Hybrid B&A auction --- no bid:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction --- currency check --- nothing configured:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction --- sellerCurrency mismatch:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction --- sellerCurrency config, no bidCurrency:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Hybrid B&A auction --- no bid:
- /fledge/tentative/server-response.https.window.html?17-20 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction - response marked as non-chaff:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - incorrectly includes topLevelSeller:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - http:// topLevelSeller is bad, too:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - positive bid is good:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction - response marked as non-chaff:
- /fledge/tentative/server-response.https.window.html?1-4 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction with reporting URLs:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction with reporting URLs:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction:
- /fledge/tentative/server-response.https.window.html?33-36 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction - buyerAndSellerReportingId in ad:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - buyerAndSellerReportingId in wrong ad:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - ad component URL not in ad:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - ad component URL in ad:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction - buyerAndSellerReportingId in ad:
- /fledge/tentative/server-response.https.window.html?13-16 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction - nonsense error field:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - response marked as error, with message:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - response marked as error, with bad message:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - response marked as chaff:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction - nonsense error field:
- /fledge/tentative/server-response.https.window.html?25-28 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction - too large bidding group index:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - wrong IG name:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - left IG in the middle:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - ad URL not in ad:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction - too large bidding group index:
- /fledge/tentative/server-response.https.window.html?5-8 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction - fault inject at CBOR:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - fault inject at gzip:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - fault inject at framing:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - fault inject at encryption:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction - fault inject at CBOR:
- /fledge/tentative/server-response.https.window.html?29-32 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction - buyerReportingId not in ad:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - buyerReportingId in ad:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - buyerReportingId in wrong ad:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - buyerAndSellerReportingId not in ad:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction - buyerReportingId not in ad:
- /fledge/tentative/server-response.https.window.html?9-12 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Basic B&A auction - Wrong authorization:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - Wrong seller:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - Wrong request Id:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Basic B&A auction - response marked as error:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Basic B&A auction - Wrong authorization:
- /fledge/tentative/server-response.https.window.html?45-48 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)- Hybrid B&A auction --- top perBuyerCurrencies mismatch:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction --- perBuyerCurrencies config, no bidCurrency:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction --- bid info passed to top-level scoreAd:
FAIL
(Chrome:FAIL
, Safari:FAIL
) - Hybrid B&A auction --- bid info passed to top-level reporting:
FAIL
(Chrome:FAIL
, Safari:FAIL
)
- Hybrid B&A auction --- top perBuyerCurrencies mismatch:
Tests Disabled in Gecko Infrastructure
- /fledge/tentative/server-response.https.window.html?37-40 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?21-24 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?41-44 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?17-20 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?1-4 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?33-36 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?13-16 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?25-28 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?5-8 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?29-32 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?9-12 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
) - /fledge/tentative/server-response.https.window.html?45-48 [wpt.fyi]:
OK
[GitHub
],SKIP
[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview
,Gecko-android-em-7.0-x86_64-qr-debug-geckoview
,Gecko-android-em-7.0-x86_64-qr-opt-geckoview
,Gecko-linux1804-64-qr-debug
,Gecko-linux1804-64-qr-opt
,Gecko-windows11-32-2009-qr-debug
,Gecko-windows11-32-2009-qr-opt
,Gecko-windows11-64-2009-qr-debug
,Gecko-windows11-64-2009-qr-opt
] (Chrome:OK
, Safari:OK
)
Comment 5•1 month ago
|
||
bugherder |
Description
•