ochafik/llama.cpp

Pull Requests Commits
vulkan: support copy from f32 to q4_0/q4_1/q5_0/q5_1/q8_0/iq4_nl (#11166)
jeffbolznv committed 1 year ago
Verified bd38ddea
vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (#11206)
jeffbolznv committed 1 year ago
Verified 466300fe
vulkan: optimize coopmat2 q2_k dequant function (#11130)
jeffbolznv committed 1 year ago
Verified 206bc534
llama : add internlm3 support (#11233)
RunningLeon committed 1 year ago
Verified 4dbc8b9c
CUDA: backwards pass for misc. ops, add tests (#11257)
JohannesGaessler committed 1 year ago
Verified 9c8dcefe
llama : add `llama_model_load_from_splits` (#11255)
ngxson committed 1 year ago
Verified 681149ce
ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (#11227)
fj-y-saito committed 1 year ago
Verified c67cc983
vulkan: scale caching for k quants + misc fixes (#11081)
netrunnereve committed 1 year ago
Verified adc5dd92
ci : use -no-cnv in gguf-split tests (#11254)
ggerganov committed 1 year ago
Verified f11cfdfd
fix: ggml: fix vulkan-shaders-gen build (#10448)
sparkleholic committed 1 year ago
Verified 1d850433
RoPE: fix back, CUDA support for back + noncont. (#11240)
JohannesGaessler committed 1 year ago
Verified 432df2d5
examples : add embd_to_audio to tts-outetts.py [no ci] (#11235)
danbev committed 1 year ago
Verified 0ccd7f3e
SYCL: Add gated linear attention kernel (#11175)
qnixsynapse committed 1 year ago
Verified f446c2cf
ci : add -no-cnv for tests (#11238)
ngxson committed 1 year ago
Verified b4d92a59
vocab : add dummy tokens for "no_vocab" type (#11231)
ggerganov committed 1 year ago
Verified bbf3e55e
server : Improve code snippets direction between RTL text (#11221)
ebraminio committed 1 year ago
Verified c5bf0d1b
Refactor test-chat-template.cpp (#11224)
ochafik committed 1 year ago
Verified 091592d7
sync : ggml
ggerganov committed 1 year ago
Verified 44d1e796
scripts : sync gguf (cont)
ggerganov committed 1 year ago
Verified a4f3f5d8
scripts : sync gguf
ggerganov committed 1 year ago
Verified 48e1ae0e
scripts : sync opencl
ggerganov committed 1 year ago
Verified d00a80e8
server : (UI) Improve messages bubble shape in RTL (#11220)
ebraminio committed 1 year ago
Verified 504af20e
cli : auto activate conversation mode if chat template is available (#11214)
ngxson committed 1 year ago
Verified 84a44815
cuda : CUDA Graph Compute Function Refactor (precursor for performance improvements) (#11042)
aendk committed 1 year ago
Verified 39509fb0
contrib : add naming guidelines (cont) (#11177)
ggerganov committed 1 year ago
Verified a29f0870
server : (UI) Support for RTL text as models input or output (#11208)
ebraminio committed 1 year ago
Verified 437e05f7
contrib : add naming guidelines (cont) (#11177)
ggerganov committed 1 year ago
Verified ca001f66
common : support tag-based --hf-repo like on ollama (#11195)
ngxson committed 1 year ago
Verified 00b4c3da
contrib : add naming guidelines (#11177)
ggerganov committed 1 year ago
Verified 7426a26b
llama : remove 'd' from bad special token log (#11212)
danbev committed 1 year ago
Verified 8f70fc3d
Terms Of Use Privacy Policy Refund Policy Impressum