(In reply to Abhishek from comment #1) > As a sanity check, I tested my implementation of the matrix-multiply intrinsics along with the [intgemm sources](https://bugzilla.mozilla.org/show_bug.cgi?id=1722102) in Firefox Nightly for Bergamot project and I could do the inference successfully on MacOS. > > Further, I benchmarked the following setups to compare the translation speeds: > 1. `Wasm Gemm` : Gemm library (intgemm) compiled to wasm > 2. `Wormhole` : Gemm library (intgemm) compiled to wasm but using wormhole for 3 most expensive Intel instructions > 3. `Native Firefox gemm` : Entire Gemm library (intgemm) exported as intrinsics from within Firefox > 1. I could benchmark both SSSE3 and AVX2 > > I am using the same translator configuration for benchmarking. > > Models used for evaluation: [English -> German](https://github.com/mozilla/firefox-translations-models/tree/main/models/prod/ende), [English -> Spanish](https://github.com/mozilla/firefox-translations-models/tree/main/models/prod/enes) > > Length of the text used for translation: ~5000 words > > wps: Translation speed measured in words per second > > Results: > 1. `Wasm Gemm` : 95 wps [Profiler](https://share.firefox.dev/3p44Ej6) > 2. `Wormhole` : 390 wps (+310% to Wasm Gemm), [Profiler](https://share.firefox.dev/3dZm0HO) > 3. `Native Firefox gemm` > 1. SSSE3 : 490 wps (+25% to Wormhole, +415% to Wasm Gemm), [Profiler](https://share.firefox.dev/3oYFl28) > 2. AVX2 : 560 wps (+43% to Wormhole, +489% to Wasm Gemm), [Profiler](https://share.firefox.dev/3IVHuDt)
Bug 1746631 Comment 2 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
a