Closed Bug 1919988 Opened 1 year ago Closed 1 year ago

[wpt-sync] Sync PR 48266 - FLEDGE: WPT test some of the B&A message and checking.

Categories

(Testing :: web-platform-tests, task, P4)

task

Tracking

(firefox132 fixed)

RESOLVED FIXED
132 Branch
Tracking Status
firefox132 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 48266 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/48266
Details from upstream follow.

Maks Orlovich <morlovich@chromium.org> wrote:

FLEDGE: WPT test some of the B&A message and checking.

... with focus on single-party auctions.

Change-Id: Ifb65d0b67ebf4293224bd8a12e9fa724b2320de7
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/5866311
Reviewed-by: Russ Hamilton \<behamilton@google.com>
Commit-Queue: Maks Orlovich \<morlovich@chromium.org>
Cr-Commit-Position: refs/heads/main@{#1357738}

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 10 tests and 4 subtests

Status Summary

Firefox

OK : 10
FAIL: 38

Chrome

OK : 10
FAIL: 38

Safari

OK : 10
FAIL: 38

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /fledge/tentative/server-response.https.window.html?37-40 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - invalid ad currency: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - valid ad currency: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?33-36 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - buyerAndSellerReportingId in ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - buyerAndSellerReportingId in wrong ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - ad component URL not in ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - ad component URL in ad: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?13-16 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - nonsense error field: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - response marked as error, with message: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - response marked as error, with bad message: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - response marked as chaff: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?21-24 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - negative bid is bad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - zero bid is bad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - winning group did not bid: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - negative bidding group index: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?25-28 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - too large bidding group index: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - wrong IG name: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - left IG in the middle: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - ad URL not in ad: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?5-8 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - fault inject at CBOR: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - fault inject at gzip: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - fault inject at framing: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - fault inject at encryption: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?29-32 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - buyerReportingId not in ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - buyerReportingId in ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - buyerReportingId in wrong ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - buyerAndSellerReportingId not in ad: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?9-12 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - Wrong authorization: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - Wrong seller: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - Wrong request Id: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - response marked as error: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?17-20 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - response marked as non-chaff: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - incorrectly includes topLevelSeller: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - http:// topLevelSeller is bad, too: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - positive bid is good: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?1-4 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction with reporting URLs: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction with reporting URLs: FAIL (Chrome: FAIL, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

  • /fledge/tentative/server-response.https.window.html?37-40 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?33-36 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?13-16 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?21-24 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?25-28 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?5-8 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?29-32 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?9-12 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?17-20 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?1-4 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/009ee99395c9 [wpt PR 48266] - FLEDGE: WPT test some of the B&A message and checking., a=testonly
Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → FIXED
Target Milestone: --- → 132 Branch
You need to log in before you can comment on or make changes to this bug.