ochafik/llama.cpp

Pull Requests Commits
CUDA: fix FP16 cuBLAS GEMM (#11396)
JohannesGaessler committed 1 year ago
Verified c5d9effb
rocBLAS: Avoid fp32->fp16->fp32 conversion on cdna (#11356)
IMbackK committed 1 year ago
Verified 9fbadaef
release : pack /lib in the packages (#11392)
ggerganov committed 1 year ago
Verified 9755129c
docs : Update readme to build targets for local docker build (#11368)
JafarAbdi committed 1 year ago
Verified a07c2c8a
CPU/CUDA: fix (GQA) mul mat back, add CUDA support (#11380)
JohannesGaessler committed 1 year ago
Verified 8137b4bb
cmake : avoid -march=native when reproducible build is wanted (#11366)
Bernhard M. Wiedemann committed 1 year ago
Verified 1af6945e
Update llama-run README.md (#11386)
ericcurtin committed 1 year ago
Verified 01f37edf
server : (webui) put DeepSeek R1 CoT in a collapsible <details> element (#11364)
stduhpf committed 1 year ago
Verified c07e87f3
tests: fix some mul_mat test gaps (#11375)
jeffbolznv committed 1 year ago
Verified 564804b7
Update documentation (#11373)
ericcurtin committed 1 year ago
Verified 05f63cc9
Add -ngl (#11372)
ericcurtin committed 1 year ago
Verified f7fb43cd
server : add more clean up when cancel_tasks is called (#11340)
ngxson committed 1 year ago
Verified 58456616
Treat hf.co/ prefix the same as hf:// (#11350)
ericcurtin committed 1 year ago
Verified f211d1dc
Vulkan-run-test: fix mmq_wg_denoms (#11343)
AMD-dwang committed 1 year ago
Verified 955a6c2d
vulkan: sort shaders for more deterministic binary (#11315)
jeffbolznv committed 1 year ago
Verified 1971adf5
vulkan: fix diag_mask_inf (#11323)
jeffbolznv committed 1 year ago
Verified 5245729e
main : update README documentation for batch size (#11353)
slaren committed 1 year ago
Verified 6152129d
readme : add plugin links (#11355)
ggerganov committed 1 year ago
Verified 16d3df7a
server : fix draft context not being released (#11354)
slaren committed 1 year ago
Verified 12c2bdf2
`minja`: sync at https://github.com/google/minja/commit/0f5f7f2b3770eb682fbc11763266d45204173686 (#11352)
ochafik committed 1 year ago
Verified c64d2bec
Adding logprobs to /v1/completions (#11344)
jpodivin committed 1 year ago
Verified 96f40539
`common`: utils to split / join / repeat strings (from json converter) (#11342)
ochafik committed 1 year ago
Verified a94f3b27
llava : support Minicpm-omni (#11289)
tc-mb committed 1 year ago
Verified 3e3357fd
Add Jinja template support (#11016)
ochafik committed 1 year ago
Verified 6171c9d2
export-lora : fix tok_embd tensor (#11330)
ngxson committed 1 year ago
Verified e28245f3
rpc : better caching of the base buffer pointer (#11331)
rgerganov committed 1 year ago
Verified 6da5bec8
linenoise.cpp refactoring (#11301)
ericcurtin committed 1 year ago
Verified 2e2f8f09
metal : fix out-of-bounds write (#11314)
ggerganov committed 1 year ago
Verified 2139667e
common : add -hfd option for the draft model (#11318)
ggerganov committed 1 year ago
Verified 80d0d6b4
vulkan: fix coopmat2 validation failures (#11284)
jeffbolznv committed 1 year ago
Verified aea8ddd5
Terms Of Use Privacy Policy Refund Policy Impressum