[wpt-sync] Sync PR 62608 - [Gemma4 WPTs] Restrict decimal regex constraint in WPT to valid range
Categories
(Testing :: web-platform-tests, task, P4)
Tracking
(firefox158 fixed)
| Tracking | Status | |
|---|---|---|
| firefox158 | --- | fixed |
People
(Reporter: wpt-sync, Unassigned)
References
()
Details
(Whiteboard: [wptsync downstream])
Sync web-platform-tests PR 62608 into mozilla-central (this bug is closed when the sync is complete).
PR: https://github.com/web-platform-tests/wpt/pull/62608
Details from upstream follow.
Isaac Ahouma <iahouma@google.com> wrote:
[Gemma4 WPTs] Restrict decimal regex constraint in WPT to valid range
The prompt asks for a rating between -1.0 and 1.0, but the previous
regex constraint allowed numbers outside this range (e.g. 1.5, 3.8).
Because constrained decoding allows any tokens matching the regex, the
model occasionally produced valid floats outside [-1.0, 1.0], causing
the subsequent numerical assertions to fail.Update the regex to strictly match the requested [-1.0, 1.0] range.
Bug: 547951465
Change-Id: I88f40973332c7edb1ca63e76f406c453500f4a68
Fixed: 547951465Reviewed-on: https://chromium-review.googlesource.com/8390437
WPT-Export-Revision: 0e02a9e0621c563dc8df2fe60f5ea18c52f9ac1b
| Assignee | ||
Updated•2 months ago
|
| Assignee | ||
Updated•2 months ago
|
| Assignee | ||
Comment 1•2 months ago
|
||
Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=39c9234bcf09417dc8500bd94aabfac8d6da06e7
| Assignee | ||
Comment 2•2 months ago
|
||
CI Results
Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI
Total 19 tests and 1 subtests
Status Summary
Firefox
OK : 1[GitHub] 19[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt]
FAIL : 1[GitHub] 19[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-32-25h2-debug, Gecko-windows11-32-25h2-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt]
Chrome
TIMEOUT: 2
Safari
OK : 1
FAIL : 1
Links
Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base
Details
New Tests That Don't Pass
- /ai/language-model/response-constraint/regex/boolean.tentative.https.window.html [wpt.fyi]
- Prompt should work with a boolean regex constraint.:
FAIL
- Prompt should work with a boolean regex constraint.:
- /ai/language-model/response-constraint/regex/bullet-points.tentative.https.window.html [wpt.fyi]
- Prompt should work with a bullet points regex constraint.:
FAIL
- Prompt should work with a bullet points regex constraint.:
- /ai/language-model/response-constraint/regex/character-range.tentative.https.window.html [wpt.fyi]
- Prompt should work with a character range regex constraint.:
FAIL
- Prompt should work with a character range regex constraint.:
- /ai/language-model/response-constraint/regex/csv-row.tentative.https.window.html [wpt.fyi]
- Prompt should work with a CSV row regex constraint.:
FAIL
- Prompt should work with a CSV row regex constraint.:
- /ai/language-model/response-constraint/regex/date.tentative.https.window.html [wpt.fyi]
- Prompt should work with a date regex constraint.:
FAIL
- Prompt should work with a date regex constraint.:
- /ai/language-model/response-constraint/regex/decimal.tentative.https.window.html [wpt.fyi]
- Prompt should work with a decimal regex constraint.:
FAIL(Chrome:TIMEOUT, Safari:FAIL)
- Prompt should work with a decimal regex constraint.:
- /ai/language-model/response-constraint/regex/email.tentative.https.window.html [wpt.fyi]
- Prompt should work with an email regex constraint.:
FAIL
- Prompt should work with an email regex constraint.:
- /ai/language-model/response-constraint/regex/enumeration.tentative.https.window.html [wpt.fyi]
- Prompt should work with an enumeration regex constraint.:
FAIL
- Prompt should work with an enumeration regex constraint.:
- /ai/language-model/response-constraint/regex/exact-length.tentative.https.window.html [wpt.fyi]
- Prompt should work with an exact length regex constraint.:
FAIL
- Prompt should work with an exact length regex constraint.:
- /ai/language-model/response-constraint/regex/integer.tentative.https.window.html [wpt.fyi]
- Prompt should work with an integer regex constraint.:
FAIL
- Prompt should work with an integer regex constraint.:
- /ai/language-model/response-constraint/regex/list.tentative.https.window.html [wpt.fyi]
- Prompt should work with a list regex constraint.:
FAIL
- Prompt should work with a list regex constraint.:
- /ai/language-model/response-constraint/regex/literal.tentative.https.window.html [wpt.fyi]
- Prompt should work with a literal regex constraint.:
FAIL
- Prompt should work with a literal regex constraint.:
- /ai/language-model/response-constraint/regex/max-length.tentative.https.window.html [wpt.fyi]
- Prompt should work with a max length regex constraint.:
FAIL
- Prompt should work with a max length regex constraint.:
- /ai/language-model/response-constraint/regex/prefix-bad.tentative.https.window.html [wpt.fyi]
- Prompt should reject if the prefix deviates from the regex constraint.:
FAIL
- Prompt should reject if the prefix deviates from the regex constraint.:
- /ai/language-model/response-constraint/regex/prefix-good.tentative.https.window.html [wpt.fyi]
- Prompt should work with a valid regex constraint and matching prefix.:
FAIL
- Prompt should work with a valid regex constraint and matching prefix.:
- /ai/language-model/response-constraint/regex/quote.tentative.https.window.html [wpt.fyi]
- Prompt should work with a quote regex constraint.:
FAIL
- Prompt should work with a quote regex constraint.:
- /ai/language-model/response-constraint/regex/time.tentative.https.window.html [wpt.fyi]
- Prompt should work with a time regex constraint.:
FAIL
- Prompt should work with a time regex constraint.:
- /ai/language-model/response-constraint/regex/url.tentative.https.window.html [wpt.fyi]
- Prompt should work with a URL regex constraint.:
FAIL
- Prompt should work with a URL regex constraint.:
- /ai/language-model/response-constraint/regex/word.tentative.https.window.html [wpt.fyi]
- Prompt should work with a word regex constraint.:
FAIL
- Prompt should work with a word regex constraint.:
Comment 4•2 months ago
|
||
| bugherder | ||
Description
•