convert : allow partial update to the chkhsh pre-tokenizer list (#13847)

* convert : allow partial update to the chkhsh pre-tokenizer list * code style * update tokenizer out * rm inp/out files for models not having gguf * fixed hash for glm * skip nomic-bert-moe test * Update convert_hf_to_gguf_update.py * fix minerva-7b hash * rm redundant import
2025-05-30 12:24:37 +02:00 · 2025-05-30 12:24:37 +02:00 · 07e4351ce6
commit 07e4351ce6
parent 291f2b6913
43 changed files with 159 additions and 1208 deletions
--- a/models/ggml-vocab-deepseek-coder.gguf.out
+++ b/models/ggml-vocab-deepseek-coder.gguf.out
@ -1,5 +1,5 @@
 1050 207 19 207 19192 4217
- 37 32009 71 6247
+ 125 213 26862 282

 207
 243