ver4a/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

llama : one-off chat template fix for Mistral-Small-2503 (#13398)

Browse source 
* llama : one-off chat template fix for Mistral-Small-2503

* update readme

* add mistral-v7-tekken
This commit is contained in:
Xuan-Son Nguyen 2025-05-09 11:17:51 +02:00 • committed by GitHub
parent b486ba05bf
commit 3f96aeff39
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 18 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

2
tools/mtmd/README.md
View file

@ -46,7 +46,7 @@ llama-mtmd-cli -hf ggml-org/Qwen2.5-VL-32B-Instruct-GGUF
llama-mtmd-cli -hf ggml-org/Qwen2.5-VL-72B-Instruct-GGUF
# Mistral Small 3.1 24B (IQ2_M quantization)
llama-mtmd-cli -hf ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF --chat-template mistral-v7
llama-mtmd-cli -hf ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
```
## How it works and what is `mmproj`?