llama.cpp
llama : stream MoE routed experts from disk
#25294
Open
Overview
Commits
3
Changes
View On GitHub

llama : stream MoE routed experts from disk #25294

freedomljc wants to merge 3 commits into ggml-org:master from freedomljc:feat/moe-streaming-core
freedomljc
freedomljc llama : stream MoE routed experts from disk (core + async pool + O_DI…
4260e460
freedomljc freedomljc requested a review from CISC CISC 2 days ago
freedomljc freedomljc requested a review from ggerganov ggerganov 2 days ago
freedomljc freedomljc requested a review 2 days ago
ggml-gh-bot
freedomljc support waved prefill
db5268ff
Midaychi
freedomljc
freedomljc Merge remote-tracking branch 'upstream/master' into feat/moe-streamin…
1248fd8f

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum