ggerganov/llama.cpp

Pull Requests Commits
Add support for ArcticForCausalLM (#7020)
fairydreaming committed 1 year ago
Verified fbca2f27
add build shared lib in win release package (#7438)
arthw committed 1 year ago
Verified 0df0aa8e
readme : remove trailing space (#7469)
ggerganov committed 1 year ago
Verified 74f33adf
ggml : silence UB sanitizer error during iq2_xxs quantization (#0)
ggerganov committed 1 year ago
Verified 1debe727
Fix phi3 chat template confusion with zephyr (#7449)
tristandruyen committed 1 year ago
Verified 007489e8
readme : add Bunny in supported models [no ci] (#7469)
criminact committed 1 year ago
Verified 8b94e799
llama : add getters for n_threads/n_threads_batch (#7464)
danbev committed 1 year ago
Verified 3015851c
ci : use Pythia models instead of OpenLlama (#7470)
ggerganov committed 1 year ago
Verified 55ac3b7a
readme : add GPT-NeoX + Pythia to the list of supported models (#7491)
felladrin committed 1 year ago
Verified dacfcebd
Add missing inference support for GPTNeoXForCausalLM (Pythia and GPT-NeoX base models) (#7461)
fairydreaming committed 1 year ago
Verified 9b82476e
llama : rename n_ctx -> cache.size, less confusing (#0)
ggerganov committed 1 year ago
Verified a61a94e5
labeler.yml: add embedding label detector [no ci] (#7482)
mofosyne committed 1 year ago
Verified 152da28a
ggml : remove ggml_flash_attn and ggml_flash_ff (#7463)
ggerganov committed 1 year ago
Verified d48c88cb
ggml : drop support for QK_K=64 (#7473)
ggerganov committed 1 year ago
Verified e84b71c2
Update vulkan rope implementation to support frequency factors (#7475)
0cc4m committed 1 year ago
Verified 1b1e27cb
main : minor (#7462)
ggerganov committed 1 year ago
Verified fbf777d2
CUDA: fix FA out-of-bounds reads (#7479)
JohannesGaessler committed 1 year ago
Verified cd93a28c
SimpleChat: a simple and dumb web front end for testing /chat/completions and /completions end points and try chat (#7350)
hanishkvc committed 1 year ago
Verified 1e374365
build : remove zig (#7471)
ggerganov committed 1 year ago
Verified 197ff914
common : normalize naming style (#7462)
ggerganov committed 1 year ago
Verified 6ff13987
CUDA: fix FA out-of-bounds writes (#7465)
JohannesGaessler committed 1 year ago
Verified 38c03478
phi3 : duplicate rope factors in each layer (#7447)
slaren committed 1 year ago
Verified b18532a4
vulkan: add workaround for iterator boundary check to fix clang-cl debug build (#7426)
Adriankhl committed 1 year ago
Verified fcda1128
llama : add missing model type names (#7445)
jart committed 1 year ago
Verified 03d8900e
cuda : fix compile warning (#7454)
ggerganov committed 1 year ago
Verified 9b3d8331
CUDA: remove incorrect precision check (#7454)
JohannesGaessler committed 1 year ago
Verified 95fb0aef
cuda : fix rope + add tests (#7452)
ggerganov committed 1 year ago
Verified 3e5faa85
llama : add phi3 128K model support (#7225)
liuwei-git committed 1 year ago
Verified 201cc11a
metal : handle F16 inf values, fix FA partial offload (#7434)
ggerganov committed 1 year ago
Verified 6369bf04
`grammars`: fix resampling logic regression (#7424)
ochafik committed 1 year ago
Verified e402de36
Terms Of Use Privacy Policy Refund Policy Impressum