Open
Bug 1955352
Opened 1 year ago
Updated 1 year ago
Use MessageChannel for direct communication between worker and parent
Categories
(Core :: Machine Learning: General, enhancement)
Core
Machine Learning: General
Tracking
()
ASSIGNED
People
(Reporter: atossou, Assigned: atossou)
References
(Depends on 1 open bug)
Details
(Whiteboard: [genai])
Use MessageChannel for direct communication between worker and parent
Should lead to speedup across the board especially for model with large output such as embeddings both on onnx and wllama.
Will enable backend specific feature such as stop/resume/go back for text generation with wllama.
|
||
Updated•1 year ago
|
|
Assignee | |
Updated•1 year ago
|
Assignee: nobody → atossou
Status: NEW → ASSIGNED
You need to log in
before you can comment on or make changes to this bug.
Description
•