1960729 - Add kokoro custom pipeline task to ONNXPipeline

Status: NEW

(Core :: Machine Learning, enhancement, P5)

Description

[Rebecca Hadi]

Add Kokoro custom pipeline to ONNXPipeline as "moz-text-to-speech"

Related to https://bugzilla.mozilla.org/show_bug.cgi?id=1943148

Because Kokoro has its own phonemizer, we need to instrument a custom ONNX pipeline borrowing from work done in moz-image-to-text

Scope of change:

• ONNXPipeline.mjs:
  • add TextToSpeech function
  • add moz-text-to-speech task

-Requires adding phonemizer from kokoro.js library under vendor

-The request will return the raw audio which can then be rendered

• Perftest will be added as well

Comment 1

[Rebecca Hadi]

Attachment: WIP: Bug 1960729 - Add kokoro custom pipeline task to ONNXPipeline