ggml-org/llama.cpp

Pull Requests Commits
ci : use Pythia models instead of OpenLlama (#7470)
ggerganov committed 1 year ago
Verified 55ac3b7a
readme : add GPT-NeoX + Pythia to the list of supported models (#7491)
felladrin committed 1 year ago
Verified dacfcebd
Add missing inference support for GPTNeoXForCausalLM (Pythia and GPT-NeoX base models) (#7461)
fairydreaming committed 1 year ago
Verified 9b82476e
llama : rename n_ctx -> cache.size, less confusing (#0)
ggerganov committed 1 year ago
Verified a61a94e5
labeler.yml: add embedding label detector [no ci] (#7482)
mofosyne committed 1 year ago
Verified 152da28a
ggml : remove ggml_flash_attn and ggml_flash_ff (#7463)
ggerganov committed 1 year ago
Verified d48c88cb
ggml : drop support for QK_K=64 (#7473)
ggerganov committed 1 year ago
Verified e84b71c2
Update vulkan rope implementation to support frequency factors (#7475)
0cc4m committed 1 year ago
Verified 1b1e27cb
main : minor (#7462)
ggerganov committed 1 year ago
Verified fbf777d2
CUDA: fix FA out-of-bounds reads (#7479)
JohannesGaessler committed 1 year ago
Verified cd93a28c
SimpleChat: a simple and dumb web front end for testing /chat/completions and /completions end points and try chat (#7350)
hanishkvc committed 1 year ago
Verified 1e374365
build : remove zig (#7471)
ggerganov committed 1 year ago
Verified 197ff914
common : normalize naming style (#7462)
ggerganov committed 1 year ago
Verified 6ff13987
CUDA: fix FA out-of-bounds writes (#7465)
JohannesGaessler committed 1 year ago
Verified 38c03478
phi3 : duplicate rope factors in each layer (#7447)
slaren committed 1 year ago
Verified b18532a4
vulkan: add workaround for iterator boundary check to fix clang-cl debug build (#7426)
Adriankhl committed 1 year ago
Verified fcda1128
llama : add missing model type names (#7445)
jart committed 1 year ago
Verified 03d8900e
cuda : fix compile warning (#7454)
ggerganov committed 1 year ago
Verified 9b3d8331
CUDA: remove incorrect precision check (#7454)
JohannesGaessler committed 1 year ago
Verified 95fb0aef
cuda : fix rope + add tests (#7452)
ggerganov committed 1 year ago
Verified 3e5faa85
llama : add phi3 128K model support (#7225)
liuwei-git committed 1 year ago
Verified 201cc11a
metal : handle F16 inf values, fix FA partial offload (#7434)
ggerganov committed 1 year ago
Verified 6369bf04
`grammars`: fix resampling logic regression (#7424)
ochafik committed 1 year ago
Verified e402de36
CUDA: fix unused warning in mmq.cu (#7442)
JohannesGaessler committed 1 year ago
Verified fcf6538b
tests : test-tokenizer-0.sh print more info (#7402)
ggerganov committed 1 year ago
Verified c3f8d583
examples: cache hf model when --model not provided (#7353)
amirzia committed 1 year ago
Verified 11474e75
CUDA: deduplicate mmq code (#7397)
JohannesGaessler committed 1 year ago
Verified d8ee9022
Tokenizer SPM fixes for phi-3 and llama-spm (bugfix) (#7425)
jaime-m-p committed 1 year ago
Verified d7e852c1
Tokenizer SPM fixes for phi-3 and llama-spm (#7375)
jaime-m-p committed 1 year ago
Verified 917dc8cf
llama : remove Persimmon (#7408)
ggerganov committed 1 year ago
Verified fabf30b4
Terms Of Use Privacy Policy Refund Policy Impressum