Land armgemm support for Firefox Translations
Categories
(Core :: JavaScript: WebAssembly, enhancement)
Tracking
()
People
(Reporter: anatal, Unassigned)
References
Details
Similar to what was done on [1] and [2] with the intgemm libraries we need to land and ship to release an optimized matrix multiplication library for ARM processors that could be utilized by and exposed to Firefox Translations machine translation Wasm module to speed up the local translations on Android and ARM based computers.
A library was provided by our bergamot university partners [3] which actually encapsulates both intgemm and ruy (aka armgemm) and switches between them based in the architecture, and also provides the proper interfaces platform. Ruy also depends on cpuinfo and a minified version [4] was also provided with the integration purpose in mind.
@yury Would this align with the conversations we had? And how do you see we moving forward with these, in a similar fashion we did with intgemm? Can we reutilize some parts of what was done there?
[1] https://bugzilla.mozilla.org/show_bug.cgi?id=1722102
[2] https://bugzilla.mozilla.org/show_bug.cgi?id=1746631
[3] https://github.com/jerinphilip/MozIntGemm/releases/tag/v1.0.0
[4] https://github.com/browsermt/cpuinfo
|
||
Updated•2 years ago
|
|
||
Comment 1•2 years ago
|
||
Would this align with the conversations we had? And how do you see we moving forward with these, in a similar fashion we did with intgemm? Can we reutilize some parts of what was done there
You can re-use [2], and only IntegerGemmIntrinsic.cpp file needs to be updated to include armgemm instead of intgemm. Integration tests in the [2] are good too, but they are not testing correctness.
|
||
Updated•2 years ago
|
|
||
Comment 2•2 years ago
|
||
We are going with another route (bug 1815790).
Description
•