Open Bug 1891685 Opened 9 months ago Updated 9 months ago

Document the performance and hardware requirements for inference

Categories

(Core :: Machine Learning, enhancement)

Product:
Core
Component:
Machine Learning
Type:
enhancement

Tracking

()

People

(Reporter: tarek, Assigned: tarek)

References

Details

(Whiteboard: [genai])

We should add a benchmark test and run it on a series of hardware

From a meeting with the performance gang:

  • Implement telemetry probes and collect all of the data. An example glean probe measuring a duration, with included data-review form https://bugzilla.mozilla.org/show_bug.cgi?id=1840703
  • Reach out to Chris H-C (chutten) to approve probe data
  • Add this benchmark in CI:
Type: defect → enhancement
Whiteboard: [genai]
You need to log in before you can comment on or make changes to this bug.