allow model loading without running an inference
Categories
(Core :: Machine Learning, enhancement)
Tracking
()
Tracking | Status | |
---|---|---|
firefox131 | --- | fixed |
People
(Reporter: tarek, Assigned: atossou)
References
Details
(Whiteboard: [genai])
Attachments
(2 files)
Right now the model download happens lazily on the first run() but that makes the UI in pdf.js hard to build because we want to download models before the first run
Let's add the ability to optionally trigger this initialization independently from a run, and have createEngine
await for it
Assignee | ||
Comment 1•6 months ago
|
||
@tarek I am taking this bug and putting it into 130. Fixing this bug makes the solution for https://bugzilla.mozilla.org/show_bug.cgi?id=1910627 easier.
Assignee | ||
Comment 2•6 months ago
|
||
Reporter | ||
Comment 3•6 months ago
|
||
The patch is quite large and complex - since we don't need it for 130, let's hold it and do it in 131.
For https://bugzilla.mozilla.org/show_bug.cgi?id=1910627 we can call the delete of the model in the flow
Reporter | ||
Updated•6 months ago
|
Assignee | ||
Comment 4•6 months ago
|
||
This patch is not changing many things. It is mostly just adding await here and there
It felt like big because we cannot await in constructor. So first we need to refactor the code into constructor + static initialization (with no changes in behavior).
I can add a global flag that will disable the features it brings (ability to await for full initialization) as originally suggested for this bug.
That way we would be able to land it.
Updated•6 months ago
|
Assignee | ||
Comment 5•6 months ago
|
||
Assignee | ||
Updated•6 months ago
|
Updated•6 months ago
|
Description
•