server : refactor multitask handling (#9274)

Browse source

* server : remove multitask from server_task

* refactor completions handler

* fix embeddings

* use res_ok everywhere

* small change for handle_slots_action

* use unordered_set everywhere

* (try) fix test

* no more "mutable" lambda

* Apply suggestions from code review

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* use deque

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

...

This commit is contained in:

Xuan Son Nguyen 2024-09-02 17:11:51 +02:00 • committed by GitHub

parent b60074f1c2

commit 6e7d133a5f

No known key found for this signature in database

GPG key ID: B5690EEEBB952194

5 changed files with 365 additions and 462 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

785

examples/server/server.cpp

View file

File diff suppressed because it is too large Load diff