Closed Bug 1920187 Opened 1 month ago Closed 1 month ago

[wpt-sync] Sync PR 48289 - FLEDGE: WPT verification of B&A component auctions...

Categories

(Testing :: web-platform-tests, task, P4)

Product:
Testing
Component:
web-platform-tests
Type:
task

Tracking

(firefox132 fixed)

Status:
RESOLVED FIXED
Milestone:
132 Branch
Tracking Flags:
Tracking Status
firefox132 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 48289 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/48289
Details from upstream follow.

Maks Orlovich <morlovich@chromium.org> wrote:

FLEDGE: WPT verification of B&A component auctions...

...and also various bid fields that are observable from them at
top-level auction level.

Change-Id: I5ad605a8c9c21563f97dbb8155d9805205f73f80
Reviewed-on: https://chromium-review.googlesource.com/5872540
WPT-Export-Revision: 6fdfc4c5773c5b093dc89b037949593317e5509e

PR 48289 applied with additional changes from upstream: 28c8706d2d34c38c1fc658e3d398161b06bda6d7

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 12 tests and 4 subtests

Status Summary

Firefox

OK : 12
FAIL: 48

Chrome

OK : 12
FAIL: 48

Safari

OK : 12
FAIL: 48

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /fledge/tentative/server-response.https.window.html?37-40 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - invalid ad currency: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - valid ad currency: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction --- missing top-level seller: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction --- wrong top-level seller: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?21-24 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - negative bid is bad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - zero bid is bad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - winning group did not bid: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - negative bidding group index: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?41-44 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Hybrid B&A auction --- no bid: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction --- currency check --- nothing configured: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction --- sellerCurrency mismatch: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction --- sellerCurrency config, no bidCurrency: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?17-20 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - response marked as non-chaff: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - incorrectly includes topLevelSeller: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - http:// topLevelSeller is bad, too: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - positive bid is good: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?1-4 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction with reporting URLs: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction with reporting URLs: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?33-36 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - buyerAndSellerReportingId in ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - buyerAndSellerReportingId in wrong ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - ad component URL not in ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - ad component URL in ad: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?13-16 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - nonsense error field: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - response marked as error, with message: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - response marked as error, with bad message: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - response marked as chaff: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?25-28 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - too large bidding group index: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - wrong IG name: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - left IG in the middle: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - ad URL not in ad: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?5-8 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - fault inject at CBOR: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - fault inject at gzip: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - fault inject at framing: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - fault inject at encryption: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?29-32 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - buyerReportingId not in ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - buyerReportingId in ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - buyerReportingId in wrong ad: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - buyerAndSellerReportingId not in ad: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?9-12 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Basic B&A auction - Wrong authorization: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - Wrong seller: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - Wrong request Id: FAIL (Chrome: FAIL, Safari: FAIL)
    • Basic B&A auction - response marked as error: FAIL (Chrome: FAIL, Safari: FAIL)
  • /fledge/tentative/server-response.https.window.html?45-48 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
    • Hybrid B&A auction --- top perBuyerCurrencies mismatch: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction --- perBuyerCurrencies config, no bidCurrency: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction --- bid info passed to top-level scoreAd: FAIL (Chrome: FAIL, Safari: FAIL)
    • Hybrid B&A auction --- bid info passed to top-level reporting: FAIL (Chrome: FAIL, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

  • /fledge/tentative/server-response.https.window.html?37-40 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?21-24 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?41-44 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?17-20 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?1-4 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?33-36 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?13-16 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?25-28 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?5-8 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?29-32 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?9-12 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • /fledge/tentative/server-response.https.window.html?45-48 [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/63d7693c46b5 [wpt PR 48289] - FLEDGE: WPT verification of B&A component auctions..., a=testonly

https://hg.mozilla.org/mozilla-central/rev/63d7693c46b5

Status: NEW → RESOLVED
Closed: 1 month ago
status-firefox132: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 132 Branch
You need to log in before you can comment on or make changes to this bug.