llama.cpp
server : add lora hotswap endpoint
#8857
Merged

server : add lora hotswap endpoint #8857

ngxson
ngxson server : add lora hotswap endpoint
e5c2d167
ngxson handle lora_no_apply
42960ec7
github-actions github-actions added examples
github-actions github-actions added server
ngxson fix build
e7d9abf3
ngxson
Green-Sky
ngxson
ggerganov
ggerganov approved these changes on 2024-08-05
mofosyne mofosyne added Review Complexity : Low
ngxson updae docs
aa3cea0f
ngxson Merge branch 'master' into xsn/lora_server_hotswap
21cb1338
ngxson clean up struct def
c58a332f
ngxson fix build
e91c5780
github-actions github-actions added python
ngxson add LoRA test
98da78b2
ngxson ngxson marked this pull request as ready for review 1 year ago
ngxson ngxson requested a review from ggerganov ggerganov 1 year ago
ngxson
ggerganov
ggerganov approved these changes on 2024-08-06
ngxson fix style
f01bc37c
ngxson ngxson merged 1e6f6554 into master 1 year ago
ngxson ngxson changed the title server : add lora hotswap endpoint (WIP) server : add lora hotswap endpoint 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone