convert : allow partial update to the chkhsh pre-tokenizer list (#13847)

* convert : allow partial update to the chkhsh pre-tokenizer list * code style * update tokenizer out * rm inp/out files for models not having gguf * fixed hash for glm * skip nomic-bert-moe test * Update convert_hf_to_gguf_update.py * fix minerva-7b hash * rm redundant import
2025-05-30 12:24:37 +02:00 · 2025-05-30 12:24:37 +02:00 · 07e4351ce6
commit 07e4351ce6
parent 291f2b6913
43 changed files with 159 additions and 1208 deletions
--- a/models/ggml-vocab-llama-spm.gguf.out
+++ b/models/ggml-vocab-llama-spm.gguf.out
@ -1,5 +1,5 @@
 474 287 29871 29946 29871 30226 7378
- 383 4000 261
+ 11585 7810 295

 259
 1678