ngxson/llama.cpp

Pull Requests Commits

ngxson committed 324 days ago

157bd11e

server : fix cleaning up stream task

ngxson committed 324 days ago

8067639c

CANN: Add Ascend CANN build ci (#10217)

xuedinge233 committed 325 days ago

Verified 466ea66f

hip : Add hipGraph and VMM support to ROCM (#11362)

IMbackK committed 325 days ago

Verified 5f0db952

CUDA: fix FP16 cuBLAS GEMM (#11396)

JohannesGaessler committed 325 days ago

Verified c5d9effb

rocBLAS: Avoid fp32->fp16->fp32 conversion on cdna (#11356)

IMbackK committed 325 days ago

Verified 9fbadaef

release : pack /lib in the packages (#11392)

ggerganov committed 325 days ago

Verified 9755129c

docs : Update readme to build targets for local docker build (#11368)

JafarAbdi committed 325 days ago

Verified a07c2c8a

CPU/CUDA: fix (GQA) mul mat back, add CUDA support (#11380)

JohannesGaessler committed 326 days ago

Verified 8137b4bb

cmake : avoid -march=native when reproducible build is wanted (#11366)

bmwiedemann committed 326 days ago

Verified 1af6945e

Update llama-run README.md (#11386)

ericcurtin committed 326 days ago

Verified 01f37edf

server : (webui) put DeepSeek R1 CoT in a collapsible <details> element (#11364)

stduhpf committed 326 days ago

Verified c07e87f3

tests: fix some mul_mat test gaps (#11375)

jeffbolznv committed 326 days ago

Verified 564804b7

Update documentation (#11373)

ericcurtin committed 326 days ago

Verified 05f63cc9

Add -ngl (#11372)

ericcurtin committed 326 days ago

Verified f7fb43cd

server : add more clean up when cancel_tasks is called (#11340)

ngxson committed 326 days ago

Verified 58456616

Treat hf.co/ prefix the same as hf:// (#11350)

ericcurtin committed 327 days ago

Verified f211d1dc

Vulkan-run-test: fix mmq_wg_denoms (#11343)

AMD-dwang committed 327 days ago

Verified 955a6c2d

vulkan: sort shaders for more deterministic binary (#11315)

jeffbolznv committed 327 days ago

Verified 1971adf5

vulkan: fix diag_mask_inf (#11323)

jeffbolznv committed 327 days ago

Verified 5245729e

main : update README documentation for batch size (#11353)

slaren committed 327 days ago

Verified 6152129d

readme : add plugin links (#11355)

ggerganov committed 327 days ago

Verified 16d3df7a

server : fix draft context not being released (#11354)

slaren committed 327 days ago

Verified 12c2bdf2

`minja`: sync at https://github.com/google/minja/commit/0f5f7f2b3770eb682fbc11763266d45204173686 (#11352)

ochafik committed 327 days ago

Verified c64d2bec

Adding logprobs to /v1/completions (#11344)

jpodivin committed 328 days ago

Verified 96f40539

`common`: utils to split / join / repeat strings (from json converter) (#11342)

ochafik committed 328 days ago

Verified a94f3b27

llava : support Minicpm-omni (#11289)

tc-mb committed 328 days ago

Verified 3e3357fd

Add Jinja template support (#11016)

ochafik committed 328 days ago

Verified 6171c9d2

export-lora : fix tok_embd tensor (#11330)

ngxson committed 328 days ago

Verified e28245f3

rpc : better caching of the base buffer pointer (#11331)

rgerganov committed 328 days ago

Verified 6da5bec8

Older