[wpt-sync] Sync PR 48266 - FLEDGE: WPT test some of the B&A message and checking.
Categories
(Testing :: web-platform-tests, task, P4)
Tracking
(firefox132 fixed)
| Tracking | Status | |
|---|---|---|
| firefox132 | --- | fixed |
People
(Reporter: wpt-sync, Unassigned)
References
()
Details
(Whiteboard: [wptsync downstream])
Sync web-platform-tests PR 48266 into mozilla-central (this bug is closed when the sync is complete).
PR: https://github.com/web-platform-tests/wpt/pull/48266
Details from upstream follow.
Maks Orlovich <morlovich@chromium.org> wrote:
FLEDGE: WPT test some of the B&A message and checking.
... with focus on single-party auctions.
Change-Id: Ifb65d0b67ebf4293224bd8a12e9fa724b2320de7
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/5866311
Reviewed-by: Russ Hamilton \<behamilton@google.com>
Commit-Queue: Maks Orlovich \<morlovich@chromium.org>
Cr-Commit-Position: refs/heads/main@{#1357738}
| Assignee | ||
Comment 1•1 year ago
|
||
| Assignee | ||
Comment 2•1 year ago
|
||
CI Results
Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI
Total 10 tests and 4 subtests
Status Summary
Firefox
OK : 10
FAIL: 38
Chrome
OK : 10
FAIL: 38
Safari
OK : 10
FAIL: 38
Links
Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base
Details
New Tests That Don't Pass
- /fledge/tentative/server-response.https.window.html?37-40 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction - invalid ad currency:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - valid ad currency:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction - invalid ad currency:
- /fledge/tentative/server-response.https.window.html?33-36 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction - buyerAndSellerReportingId in ad:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - buyerAndSellerReportingId in wrong ad:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - ad component URL not in ad:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - ad component URL in ad:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction - buyerAndSellerReportingId in ad:
- /fledge/tentative/server-response.https.window.html?13-16 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction - nonsense error field:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - response marked as error, with message:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - response marked as error, with bad message:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - response marked as chaff:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction - nonsense error field:
- /fledge/tentative/server-response.https.window.html?21-24 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction - negative bid is bad:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - zero bid is bad:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - winning group did not bid:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - negative bidding group index:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction - negative bid is bad:
- /fledge/tentative/server-response.https.window.html?25-28 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction - too large bidding group index:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - wrong IG name:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - left IG in the middle:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - ad URL not in ad:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction - too large bidding group index:
- /fledge/tentative/server-response.https.window.html?5-8 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction - fault inject at CBOR:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - fault inject at gzip:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - fault inject at framing:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - fault inject at encryption:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction - fault inject at CBOR:
- /fledge/tentative/server-response.https.window.html?29-32 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction - buyerReportingId not in ad:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - buyerReportingId in ad:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - buyerReportingId in wrong ad:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - buyerAndSellerReportingId not in ad:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction - buyerReportingId not in ad:
- /fledge/tentative/server-response.https.window.html?9-12 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction - Wrong authorization:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - Wrong seller:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - Wrong request Id:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - response marked as error:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction - Wrong authorization:
- /fledge/tentative/server-response.https.window.html?17-20 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction - response marked as non-chaff:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - incorrectly includes topLevelSeller:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - http:// topLevelSeller is bad, too:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction - positive bid is good:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction - response marked as non-chaff:
- /fledge/tentative/server-response.https.window.html?1-4 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)- Basic B&A auction:
FAIL(Chrome:FAIL, Safari:FAIL) - Basic B&A auction with reporting URLs:
FAIL(Chrome:FAIL, Safari:FAIL) - Hybrid B&A auction:
FAIL(Chrome:FAIL, Safari:FAIL) - Hybrid B&A auction with reporting URLs:
FAIL(Chrome:FAIL, Safari:FAIL)
- Basic B&A auction:
Tests Disabled in Gecko Infrastructure
- /fledge/tentative/server-response.https.window.html?37-40 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK) - /fledge/tentative/server-response.https.window.html?33-36 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK) - /fledge/tentative/server-response.https.window.html?13-16 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK) - /fledge/tentative/server-response.https.window.html?21-24 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK) - /fledge/tentative/server-response.https.window.html?25-28 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK) - /fledge/tentative/server-response.https.window.html?5-8 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK) - /fledge/tentative/server-response.https.window.html?29-32 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK) - /fledge/tentative/server-response.https.window.html?9-12 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK) - /fledge/tentative/server-response.https.window.html?17-20 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK) - /fledge/tentative/server-response.https.window.html?1-4 [wpt.fyi]:
OK[GitHub],SKIP[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview,Gecko-android-em-7.0-x86_64-qr-debug-geckoview,Gecko-android-em-7.0-x86_64-qr-opt-geckoview,Gecko-linux1804-64-qr-debug,Gecko-linux1804-64-qr-opt,Gecko-windows11-32-2009-qr-debug,Gecko-windows11-32-2009-qr-opt,Gecko-windows11-64-2009-qr-debug,Gecko-windows11-64-2009-qr-opt] (Chrome:OK, Safari:OK)
Comment 4•1 year ago
|
||
| bugherder | ||
Description
•