llava : fix moondream support (#7163)

* Revert "Revert "llava : add support for moondream vision language model (#6899)""

This reverts commit 9da243b36a.

* Fix num_positions and embeddings initialization
This commit is contained in:
Andrei 2024-05-10 02:41:10 -04:00 committed by GitHub
parent 8c570c9496
commit d11afd6652
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 71 additions and 19 deletions

View file

@ -140,6 +140,7 @@ Typically finetunes of the base models below are supported as well.
- [x] [MobileVLM 1.7B/3B models](https://huggingface.co/models?search=mobileVLM)
- [x] [Yi-VL](https://huggingface.co/models?search=Yi-VL)
- [x] [Mini CPM](https://huggingface.co/models?search=MiniCPM)
- [x] [Moondream](https://huggingface.co/vikhyatk/moondream2)
**HTTP server**