2008991 - Parse special token data from model respons in ai window

Status: VERIFIED FIXED

(Core :: Machine Learning: Frontend, task, P1)

Description

[Nick]

Add streaming parser for §...§ tagged tokens. Stream plain text immediately while buffering tokens across chunk boundaries. Emit tokens only when fully closed and flush any unfinished token at end of stream. Stubbing out token data use cases such as search.

Comment 1

[Nick]

Attachment: Bug 2008991 - Parse special token data from model respons in ai window r=mardak,omarg

Add streaming parser for §...§ tagged tokens. Stream plain text immediately while buffering tokens across chunk boundaries. Emit tokens only when fully closed and flush any unfinished token at end of stream. Stubbing out token data use cases such as search.

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/cb98d6d4176f
https://hg.mozilla.org/integration/autoland/rev/c41b9b6d974c
Parse special token data from model respons in ai window r=Mardak,ai-frontend-reviewers

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/5f4208d01299
https://hg.mozilla.org/integration/autoland/rev/01db1b9e943e
Revert "Bug 2008991 - Parse special token data from model respons in ai window r=Mardak,ai-frontend-reviewers" for causing bc failures @ browser_aichat_message.js

Comment 4

[Sandor Molnar[:smolnar]]

Backed out for causing bc failures @ browser_aichat_message.js

Backout link: https://hg.mozilla.org/integration/autoland/rev/01db1b9e943ebff643869e8503a2a7d1c042d1d3

Push with failures

Failure log -> TEST-UNEXPECTED-FAIL | browser/components/aiwindow/ui/test/browser/browser_aichat_message.js | test_ai_chat_message_rendering - Uncaught exception in test - Error: Timed out waiting: Assistant message should render with expected text

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/2d0fd55735bd
https://hg.mozilla.org/integration/autoland/rev/0b4b519c9eeb
Parse special token data from model respons in ai window r=Mardak,ai-frontend-reviewers

Comment 6

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/0b4b519c9eeb

Comment 7

[Rares Doghi, Desktop QA]

Verified as fixed in our latest Beta 149.0b1