Bug 1746631 Comment 2 Edit History

Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.

(In reply to Abhishek from comment #1)
> As a sanity check, I tested my implementation of the matrix-multiply intrinsics along with the [intgemm sources](https://bugzilla.mozilla.org/show_bug.cgi?id=1722102) in Firefox Nightly for Bergamot project and I could do the inference successfully on MacOS. 
> 
> Further, I benchmarked the following setups to compare the translation speeds:
> 1. `Wasm Gemm`              : Gemm library (intgemm) compiled to wasm
> 2. `Wormhole`                  : Gemm library (intgemm) compiled to wasm but using wormhole for 3 most expensive Intel instructions
> 3. `Native Firefox gemm` : Entire Gemm library (intgemm) exported as intrinsics from within Firefox
>     1. I could benchmark both SSSE3 and AVX2
> 
> I am using the same translator configuration for benchmarking.
> 
> Models used for evaluation: [English -> German](https://github.com/mozilla/firefox-translations-models/tree/main/models/prod/ende), [English -> Spanish](https://github.com/mozilla/firefox-translations-models/tree/main/models/prod/enes)
> 
> Length of the text used for translation: ~5000 words
> 
> wps: Translation speed measured in words per second
> 
> Results:
> 1. `Wasm Gemm`                : 95 wps      [Profiler](https://share.firefox.dev/3p44Ej6)
> 2. `Wormhole`                    : 390 wps   (+310% to Wasm Gemm), [Profiler](https://share.firefox.dev/3dZm0HO)
> 3. `Native Firefox gemm`
>     1. SSSE3                     : 490 wps   (+25% to Wormhole, +415% to Wasm Gemm), [Profiler](https://share.firefox.dev/3oYFl28)
>     2. AVX2                      : 560 wps   (+43% to Wormhole, +489% to Wasm Gemm), [Profiler](https://share.firefox.dev/3IVHuDt)
a

    

Back to Bug 1746631 Comment 2