Closed Bug 2071255 Opened 2 months ago Closed 2 months ago

[wpt-sync] Sync PR 62614 - [AI WPTs] Assert string return type for null and undefined prompt inputs

Categories

(Testing :: web-platform-tests, task, P4)

task

Tracking

(firefox158 fixed)

RESOLVED FIXED
158 Branch
Tracking Status
firefox158 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 62614 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/62614
Details from upstream follow.

Isaac Ahouma <iahouma@google.com> wrote:

[AI WPTs] Assert string return type for null and undefined prompt inputs

Assert typeof string for null and undefined inputs rather than matching
literal regex substrings.

Conversational models like Gemma 4 often respond to null or undefined
inputs by asking for clarification (e.g. "That is a very minimal
response. Could you please tell me what you would like me to do?")
rather than echoing the literal input text. Asserting typeof string
aligns with other empty-inputs tests and avoids intermittent failures.

Remove obsolete failure expectations from the AI test manifests.

Bug: 547959960
Change-Id: Ia9a82c12283942d7c72ff546167d185cd03c4b3e
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/8390497
Commit-Queue: Isaac Ahouma \<iahouma@google.com>
Reviewed-by: Mike Wasserman \<msw@chromium.org>
Cr-Commit-Position: refs/heads/main@{#1695812}

Whiteboard: [wptsync downstream] → [wptsync downstream error]
Whiteboard: [wptsync downstream error] → [wptsync downstream]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 7 tests and 1 subtests

Status Summary

Firefox

OK : 2[GitHub] 7[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt]
FAIL : 2[GitHub] 7[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt]

Chrome

TIMEOUT: 4

Safari

OK : 2
FAIL : 2

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

Pushed by wptsync@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/be2e80fe0ceb https://hg.mozilla.org/integration/autoland/rev/e7a411270dac [wpt PR 62614] - [AI WPTs] Assert string return type for null and undefined prompt inputs, a=testonly
Status: NEW → RESOLVED
Closed: 2 months ago
Resolution: --- → FIXED
Target Milestone: --- → 158 Branch
You need to log in before you can comment on or make changes to this bug.