889bdd7686
* Add BPE pre-tokenization for Command-R/R+. * Bump transformers convert requirement. * command-r : add individual digits regex --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
5 lines
100 B
Text
5 lines
100 B
Text
numpy~=1.24.4
|
|
sentencepiece~=0.1.98
|
|
transformers>=4.40.1,<5.0.0
|
|
gguf>=0.1.0
|
|
protobuf>=4.21.0,<5.0.0
|