ngxson/llama.cpp

Pull Requests Commits
ci : add ubuntu cuda build, build with one arch on windows (#10456)
slaren committed 1 year ago
Verified c6807b3f
ggml-cpu: cmake add arm64 cpu feature check for macos (#10487)
chaxu01 committed 1 year ago
Verified 25669aa9
server : fix parallel speculative decoding (#10513)
ggerganov committed 1 year ago
Verified 84e1c33c
speculative : simplify the implementation (#10504)
ggerganov committed 1 year ago
Verified 811872a5
CANN: Improve the Inferencing Performance for Ascend NPU Device (#10454)
shen-shanshan committed 1 year ago
Verified 9a4b79bc
CANN: RoPE and CANCAT operator optimization (#10488)
noemotiovon committed 1 year ago
Verified 7066b4cc
vulkan: Fix a vulkan-shaders-gen arugment parsing error (#10484)
sparkleholic committed 1 year ago
Verified 0eb4e12b
Introduce llama-run (#10291)
ericcurtin committed 1 year ago
Verified 0cc63754
ci : build docker images only once daily (#10503)
slaren committed 1 year ago
Verified 50d5cecb
server : add more information about error (#10455)
ggerganov committed 1 year ago
Verified 9fd8c268
server : enable cache_prompt by default (#10501)
ggerganov committed 1 year ago
Verified 47f931c8
metal : enable mat-vec kernels for bs <= 4 (#10491)
ggerganov committed 1 year ago
Verified 106964e3
Rename Olmo1124 to Olmo2 (#10500)
2015aroras committed 1 year ago
Verified 80acb7b4
llama : accept a list of devices to use to offload a model (#10497)
slaren committed 1 year ago
Verified 10bce045
Github: update issue templates [no ci] (#10489)
JohannesGaessler committed 1 year ago
Verified 1f922254
Add download chat feature to server chat (#10481)
brucepro committed 1 year ago
Verified a9a678a6
server : add speculative decoding support (#10455)
ggerganov committed 1 year ago
Verified 9ca2e677
ggml : add support for dynamic loading of backends (#10469)
slaren committed 1 year ago
Verified 5931c1f2
tests : fix compile warning
ggerganov committed 1 year ago
Verified f6d12e7d
metal : minor code formatting
ggerganov committed 1 year ago
Verified b7564411
[SYCL] Fix building Win package for oneAPI 2025.0 update (#10483)
NeoZhangJianyu committed 1 year ago
Verified 5a898779
speculative : refactor and add a simpler example (#10362)
ggerganov committed 1 year ago
Verified d9d54e49
flake.lock: Update (#10470)
ggerganov committed 1 year ago
Verified cce5a900
llama : fix op mul check with command-r-plus (#10476)
slaren committed 1 year ago
Verified dc39012c
convert : XLMRoberta Type Vocab Size (#10458)
gabe-l-hart committed 1 year ago
Verified 9336db46
fix gguf-py: Conversion error when multiple licenses are configured (#9807)
mmngays committed 1 year ago
Verified 96fa2c5e
ggml : do not use ARM features not included in the build (#10457)
slaren committed 1 year ago
Verified 55ed008b
ci: Update oneAPI runtime dll packaging (#10428)
MakeDecisionWorth committed 1 year ago
Verified 6dfcfef0
GitHub: ask for more info in issue templates (#10426)
JohannesGaessler committed 1 year ago
Verified 599b3e0c
CANN: Support Ascend310P to accelerate F32 and F16 Model (#10216)
leo-pony committed 1 year ago
Verified c18610b4
Terms Of Use Privacy Policy Refund Policy Impressum