1987107 - Introduce libmozinference, initially containing llama.cpp and libggml

Status: RESOLVED FIXED

(Core :: Machine Learning: General, defect)

Description

[Paul Adenot (:padenot)]

I'll add whisper.cpp shortly for speech recognition (that consists in only a few files, most of the code is in libggml).

Comment 1

[Paul Adenot (:padenot)]

Attachment: WIP: Bug 1987107 - Introduce libmozinference, initially containing llama.cpp and libggml

Comment 2

[Paul Adenot (:padenot)]

Attachment: Bug 1987107 - Introduce libmozinference, initially containing llama.cpp and libggml. r?#firefox-build-system-reviewers

Comment 3

[Paul Adenot (:padenot)]

Attachment: Bug 1987107 - Re-enable AVX2 when compiling llama.cpp. r?atossou

Comment 4

[Paul Adenot (:padenot)]

https://treeherder.mozilla.org/jobs?repo=try&revision=608d33d8044f00f4caea60438d275509616da514
https://treeherder.mozilla.org/jobs?repo=try&revision=3445cc1e3c3bc5f83532893b9f4bea6827ce0e33

(needed to link a couple libs on windows so this needed 2 try pushed)

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/21a26f57a982
https://hg.mozilla.org/integration/autoland/rev/3dae653317ca
Introduce libmozinference, initially containing llama.cpp and libggml. r=firefox-build-system-reviewers,atossou,ahochheiden
https://github.com/mozilla-firefox/firefox/commit/561bfdad0f01
https://hg.mozilla.org/integration/autoland/rev/154a86db79bb
Re-enable AVX2 when compiling llama.cpp. r=atossou
https://github.com/mozilla-firefox/firefox/commit/f9800ede06e4
https://hg.mozilla.org/integration/autoland/rev/e13439399e7a
apply code formatting via Lando

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/fd633a3612fb
https://hg.mozilla.org/integration/autoland/rev/17fa5610b4e3
Revert "Bug 1987107: apply code formatting via Lando" for causing build bustages.

Comment 7

[Serban Stanca [:SerbanS]]

Reverted this because it was causing build bustages.

• Revert link
• Push with failures
• Failure Log
• Failure line: ld.lld: error: version script assignment of 'libmozinference.so' to symbol 'ggml_threadpool_free' failed: symbol not defined

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/ae503e8c691e
https://hg.mozilla.org/integration/autoland/rev/6712f5a99300
Introduce libmozinference, initially containing llama.cpp and libggml. r=firefox-build-system-reviewers,atossou,ahochheiden
https://github.com/mozilla-firefox/firefox/commit/ead1ab67eace
https://hg.mozilla.org/integration/autoland/rev/e6b18de90d7b
Re-enable AVX2 when compiling llama.cpp. r=atossou
https://github.com/mozilla-firefox/firefox/commit/c38a7a5cbd35
https://hg.mozilla.org/integration/autoland/rev/a4eef4031ec9
apply code formatting via Lando

Comment 9

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/6712f5a99300
https://hg.mozilla.org/mozilla-central/rev/e6b18de90d7b
https://hg.mozilla.org/mozilla-central/rev/a4eef4031ec9