llama.cpp
a8063171 - server : completion requests remember slot_id

Commit

1 year ago

server : completion requests remember slot_id

References

#3677 - server : parallel decoding and multimodal (cont)

Author

ggerganov

ggerganov

Parents

Loading