convert : allow partial update to the chkhsh pre-tokenizer list (#13847)

* convert : allow partial update to the chkhsh pre-tokenizer list

* code style

* update tokenizer out

* rm inp/out files for models not having gguf

* fixed hash for glm

* skip nomic-bert-moe test

* Update convert_hf_to_gguf_update.py

* fix minerva-7b hash

* rm redundant import
This commit is contained in:
Xuan-Son Nguyen 2025-05-30 12:24:37 +02:00 committed by GitHub
parent 291f2b6913
commit 07e4351ce6
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
43 changed files with 159 additions and 1208 deletions

View file

@ -1,6 +1,6 @@
ied 4 ½ months
__ggml_vocab_test__
Führer
Äpfel
__ggml_vocab_test__
__ggml_vocab_test__