ngxson/llama.cpp

Pull Requests Commits
server : reuse cached context chunks (#9866)
ggerganov committed 1 year ago
Verified c7181bd2
flake.lock: Update (#9870)
ggerganov committed 1 year ago
Verified 92be9f12
fix perplexity
ngxson committed 1 year ago
4be7ecf2
fix save-load-state example
ngxson committed 1 year ago
6395174a
null terminated seq_id list
ngxson committed 1 year ago
7264596a
use common_batch_add, reuse llama_batch in loop
ngxson committed 1 year ago
734f9e29
Merge branch 'master' into xsn/llama_batch_remove_compat
ngxson committed 1 year ago
b4c9911e
free batch before return
ngxson committed 1 year ago
0639ff16
server : add option to time limit the generation phase (#9865)
ggerganov committed 1 year ago
Verified edc26566
server : remove self-extend features (#9860)
ggerganov committed 1 year ago
Verified 1bde94dd
server : remove legacy system_prompt feature (#9857)
ggerganov committed 1 year ago
Verified 95c76e8e
llama : improve infill support and special token detection (#9798)
ggerganov committed 1 year ago
Verified 11ac9800
musa : update doc (#9856)
yeahdongcn committed 1 year ago
Verified 943d20b4
ggml : move more prints to the ggml log system (#9839)
slaren committed 1 year ago
Verified 96776405
fix context shifting
ngxson committed 1 year ago
6a9769a2
fix
ngxson committed 1 year ago
7740c969
fix llama_bench
ngxson committed 1 year ago
59fd6b61
fix simple.cpp
ngxson committed 1 year ago
92769503
Merge branch 'master' into xsn/llama_batch_remove_compat
ngxson committed 1 year ago
99703160
adapt all examples
ngxson committed 1 year ago
1c486169
refactor llama_batch_get_one
ngxson committed 1 year ago
b226c5b1
common : use common_ prefix for common library functions (#9805)
slaren committed 1 year ago
Verified 7eee341b
rpc : add backend registry / device interfaces (#9812)
slaren committed 1 year ago
Verified 0e9f760e
musa: add docker image support (#9685)
yeahdongcn committed 1 year ago
Verified cf8e0a3b
examples : do not use common library in simple example (#9803)
slaren committed 1 year ago
Verified c7499c55
cmake : do not build common library by default when standalone (#9804)
slaren committed 1 year ago
Verified c81f3bbb
perplexity : fix integer overflow (#9783)
ggerganov committed 1 year ago
Verified e7022064
examples : remove llama.vim
ggerganov committed 1 year ago
Verified 3dc48fe7
ggml : fix BLAS with unsupported types (#9775)
slaren committed 1 year ago
Verified dca1d4b5
server : better security control for public deployments (#9776)
ngxson committed 1 year ago
Verified 458367a9
Terms Of Use Privacy Policy Refund Policy Impressum