Skip to content

Bump llama.cpp to 4fbc76dec51d0add466f0210855c0596589b60d4 - #2382

Open
jamesbiederbeck wants to merge 1 commit into
abetlen:mainfrom
jamesbiederbeck:bump-llamacpp-embeddinggemma2
Open

jamesbiederbeck wants to merge 1 commit into
abetlen:mainfrom
jamesbiederbeck:bump-llamacpp-embeddinggemma2

Conversation

@jamesbiederbeck

Copy link
Copy Markdown
Contributor

Summary

  • Bump vendored llama.cpp submodule to 4fbc76dec51d0add466f0210855c0596589b60d4

…mma 2)

Bumps the vendored llama.cpp submodule to ggml-org/llama.cpp@4fbc76dec
("model: support embeddinggemma2 (text+vision+audio)", #30054), the
commit that added the `gemma-embedding2` GGUF architecture. Without it,
loading an EmbeddingGemma 2 GGUF fails with:

  error loading model architecture: unknown model architecture: 'gemma-embedding2'

No llama-cpp-python Python binding changes are needed: the new
architecture is registered entirely inside llama.cpp's internal model
loader (src/llama-arch.*, src/models/gemma-embedding2.cpp) and doesn't
touch the public C API in include/llama.h that the ctypes bindings
mirror (the only llama.h diff in this range is two internal
session/state-file version-number bumps, unrelated to this feature).

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant