Closed Bug 2021947 Opened 1 month ago Closed 19 days ago

Telemetry: Metering

Categories

(Core :: Machine Learning: Frontend, task)

Firefox 150
task

Tracking

()

RESOLVED FIXED
150 Branch
Tracking Status
firefox150 --- fixed

People

(Reporter: jlevinsohn, Assigned: gcardieri)

References

(Blocks 2 open bugs)

Details

(Whiteboard: [genai][other])

Attachments

(2 files)

PRD Section:

Usage Metering

  • Percentage of users that are have had a single blocked attempt in a day, including the model in use
  • Log event for when a request is made that is blocked by the usage cap, including the time delta between when request is made and when they first hit the usage cap
  • Actions taken if users hit the usage cap within the next hour:
    • Close Smart Window
    • Quit Firefox
Assignee: nobody → gcardieri
Status: NEW → ASSIGNED
Summary: Telemetry: Settings, Models, Metering → Telemetry: Metering

i believe this is primarily model_response event to hook up the error extra key with how we handled errors with bug 2010417

split from bug 2009612 focusing on settings

Blocks: 1988017
Depends on: 2010417
Whiteboard: [genai][insights] → [genai][other]
See Also: → 2009612
Attachment #9552445 - Attachment description: WIP: Bug 2021947: Make usage tokens value available in the front-end for telemetry → Bug 2021947: Make usage tokens value available in the front-end for telemetry
Attachment #9552869 - Attachment description: WIP: Bug 2021947: Add Model Response Telemetry → Bug 2021947: Add Model Response Telemetry
Attachment #9552869 - Attachment description: Bug 2021947: Add Model Response Telemetry → WIP: Bug 2021947: Add Model Response Telemetry
Attachment #9552869 - Attachment description: WIP: Bug 2021947: Add Model Response Telemetry → Bug 2021947: Add Model Response Telemetry
Attachment #9552869 - Attachment description: Bug 2021947: Add Model Response Telemetry → WIP: Bug 2021947: Add Model Response Telemetry
Attachment #9552869 - Attachment description: WIP: Bug 2021947: Add Model Response Telemetry → Bug 2021947: Add Model Response Telemetry
Blocks: 2024059
Blocks: 2017416
Pushed by elee@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/48a21f39712b https://hg.mozilla.org/integration/autoland/rev/7e29c98bbbb2 Make usage tokens value available in the front-end for telemetry r=omarg,ai-frontend-reviewers,ai-models-reviewers,ai-ondevice-reviewers,npodgurski,mzhang https://github.com/mozilla-firefox/firefox/commit/2230cfe93bdd https://hg.mozilla.org/integration/autoland/rev/8cb885f8471d Add Model Response Telemetry r=npodgurski,ai-frontend-reviewers,ai-models-reviewers,omarg,mzhang,cgopal
Regressions: 2024933
Status: ASSIGNED → RESOLVED
Closed: 19 days ago
Resolution: --- → FIXED
Target Milestone: --- → 150 Branch
QA Whiteboard: [qa-triage-done-c151/b150]
Blocks: 2026608
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: