llama.cpp
Fix 24486: TP: allows the usage of 4-10 gpus for stepfun
#24554

Open

Fix 24486: TP: allows the usage of 4-10 gpus for stepfun #24554

krampenschiesser wants to merge 1 commit into ggml-org:master from krampenschiesser:fix--TP--stepfun-3.7-8+gpus

krampenschiesser requested a review from

CISC 11 days ago

CISC requested a review from

JohannesGaessler 11 days ago

krampenschiesser marked this pull request as draft 10 days ago

allows the usage of 4-10 gpus for stpefun in tensor parallel

6df847cf

krampenschiesser force pushed from 22c74601 to 6df847cf 8 days ago

krampenschiesser changed the title ~~Fix 24486: TP: allows the usage of 8,9,10 gpus for stepfun~~ Fix 24486: TP: allows the usage of 4-10 gpus for stepfun 8 days ago

krampenschiesser marked this pull request as ready for review 8 days ago

Reviewers

CISC

JohannesGaessler

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

llama.cpp Fix 24486: TP: allows the usage of 4-10 gpus for stepfun #24554 Open

Fix 24486: TP: allows the usage of 4-10 gpus for stepfun #24554

llama.cpp
Fix 24486: TP: allows the usage of 4-10 gpus for stepfun
#24554

Open