1873478 - [wpt-sync] Sync PR 43876 - Further subdivide directFromSellerSignals WPT tests.

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 43876 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/43876
Details from upstream follow.

Matt Menke <[e-mail]> wrote:

Further subdivide directFromSellerSignals WPT tests.

Tests 6-10 were marked as flaky on one bot, so switch to using
subdivisions of 4 tests.

Also, the last couple tests were added without adding new test batches,
so fix that.

Fixed: 1502382
Change-Id: I54918e7af5309beab663d3aa6b9e186487395043

Reviewed-on: https://chromium-review.googlesource.com/5177807
WPT-Export-Revision: 674bd7d91194068d3ca7e17463f50e1a847611ac

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=c6d8e5357e601b094621a0956524f951cc0f0b20

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=11687403f914b0b6afe26694a231cfadae21a7fa

Comment 3

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 8 tests and 4 subtests

Status Summary

Firefox

OK : 8
FAIL: 32

Chrome

OK : 8
FAIL: 32

Safari

OK : 8
FAIL: 32

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

• /fledge/tentative/direct-from-seller-signals.https.window.html?5-8 [wpt.fyi]
  • Test directFromSellerSignals with sellerSignals, auctionSignals and perBuyerSignals.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with single fetch and multiple auctions: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with resolved promise ad slot.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with rejected promise ad slot.: FAIL (Chrome: FAIL, Safari: FAIL)
• /fledge/tentative/direct-from-seller-signals.https.window.html?9-12 [wpt.fyi]
  • Test directFromSellerSignals that runAdAuction will wait until the promise of fetch is resolved.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with mismatched perBuyerSignals.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals does not support wildcard for buyerOrigin of perBuyerSignals.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with non-existent adSlot.: FAIL (Chrome: FAIL, Safari: FAIL)
• /fledge/tentative/direct-from-seller-signals.https.window.html?1-4 [wpt.fyi]
  • Test directFromSellerSignals with empty Ad-Auction-Signals header.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with only sellerSignals.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with only auctionSignals.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with only perBuyerSignals.: FAIL (Chrome: FAIL, Safari: FAIL)
• /fledge/tentative/direct-from-seller-signals.https.window.html?25-28 [wpt.fyi]
  • Test directFromSellerSignals with network error.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals feature detection.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with 2 responses -- the later overwrites the former.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with 3 responses -- the last response overwrites the former responses.: FAIL (Chrome: FAIL, Safari: FAIL)
• /fledge/tentative/direct-from-seller-signals.https.window.html?21-24 [wpt.fyi]
  • Test directFromSellerSignals with fetching in top frame and running auction in iframe.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with fetching and running auction in the same iframe.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with fetching in iframe 1 and running auction in iframe 2.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with fetching in iframe and running auction in top frame.: FAIL (Chrome: FAIL, Safari: FAIL)
• /fledge/tentative/direct-from-seller-signals.https.window.html?13-16 [wpt.fyi]
  • Test directFromSellerSignals with null directFromSellerSignalsHeaderAdSlot.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with no directFromSellerSignalsHeaderAdSlot.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with HTTP error.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with no returned Ad-Auction-Signals Header.: FAIL (Chrome: FAIL, Safari: FAIL)
• /fledge/tentative/direct-from-seller-signals.https.window.html?29-last [wpt.fyi]
  • Test directFromSellerSignals with 2 responses -- old non-overwritten ad slot remains.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test invalid directFromSellerSignals with duplicate adSlot in response -- the second is ignored.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test invalid directFromSellerSignals with duplicate adSlot in response, selecting a non duplicated adSlot.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test invalid directFromSellerSignals with duplicate values in response.: FAIL (Chrome: FAIL, Safari: FAIL)
• /fledge/tentative/direct-from-seller-signals.https.window.html?17-20 [wpt.fyi]
  • Test directFromSellerSignals with invalid json in Ad-Auction-Signals header.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with different fetch and seller origins.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals with same fetch and seller origins.: FAIL (Chrome: FAIL, Safari: FAIL)
  • Test directFromSellerSignals different interest group owner origin from top frame.: FAIL (Chrome: FAIL, Safari: FAIL)

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9f82bb960d26
[wpt PR 43876] - Further subdivide directFromSellerSignals WPT tests., a=testonly

Comment 5

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/9f82bb960d26