llama.cpp
llama : add --n-cpu-moe option
#15077
Merged

llama : add --n-cpu-moe option #15077

slaren merged 2 commits into master from sl/ncmoe
slaren
slaren llama : add --n-cpu-moe option
260e0301
slaren better way to avoid memory leaks in tensor_buft_overrides
fd2d1f9e
slaren slaren force pushed to fd2d1f9e 179 days ago
slaren slaren merged ec428b02 into master 179 days ago
slaren slaren deleted the sl/ncmoe branch 179 days ago
jacekpoplawski
SlavikCA
g0t4

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone