ngxson/llama.cpp

Pull Requests Commits

server : temporary fix httplib memory corruption

ngxson committed 350 days ago

37f87de0

tests: fix some mul_mat test gaps (#11375)

jeffbolznv committed 350 days ago

Verified 564804b7

Update documentation (#11373)

ericcurtin committed 350 days ago

Verified 05f63cc9

Add -ngl (#11372)

ericcurtin committed 351 days ago

Verified f7fb43cd

server : add more clean up when cancel_tasks is called (#11340)

ngxson committed 351 days ago

Verified 58456616

Treat hf.co/ prefix the same as hf:// (#11350)

ericcurtin committed 351 days ago

Verified f211d1dc

Vulkan-run-test: fix mmq_wg_denoms (#11343)

AMD-dwang committed 351 days ago

Verified 955a6c2d

vulkan: sort shaders for more deterministic binary (#11315)

jeffbolznv committed 351 days ago

Verified 1971adf5

vulkan: fix diag_mask_inf (#11323)

jeffbolznv committed 351 days ago

Verified 5245729e

main : update README documentation for batch size (#11353)

slaren committed 352 days ago

Verified 6152129d

readme : add plugin links (#11355)

ggerganov committed 352 days ago

Verified 16d3df7a

server : fix draft context not being released (#11354)

slaren committed 352 days ago

Verified 12c2bdf2

`minja`: sync at https://github.com/google/minja/commit/0f5f7f2b3770eb682fbc11763266d45204173686 (#11352)

ochafik committed 352 days ago

Verified c64d2bec

Adding logprobs to /v1/completions (#11344)

jpodivin committed 352 days ago

Verified 96f40539

`common`: utils to split / join / repeat strings (from json converter) (#11342)

ochafik committed 352 days ago

Verified a94f3b27

llava : support Minicpm-omni (#11289)

tc-mb committed 352 days ago

Verified 3e3357fd

Add Jinja template support (#11016)

ochafik committed 353 days ago

Verified 6171c9d2

export-lora : fix tok_embd tensor (#11330)

ngxson committed 353 days ago

Verified e28245f3

rpc : better caching of the base buffer pointer (#11331)

rgerganov committed 353 days ago

Verified 6da5bec8

linenoise.cpp refactoring (#11301)

ericcurtin committed 353 days ago

Verified 2e2f8f09

metal : fix out-of-bounds write (#11314)

ggerganov committed 353 days ago

Verified 2139667e

common : add -hfd option for the draft model (#11318)

ggerganov committed 353 days ago

Verified 80d0d6b4

vulkan: fix coopmat2 validation failures (#11284)

jeffbolznv committed 354 days ago

Verified aea8ddd5

examples : fix add_special conditions (#11311)

ggerganov committed 354 days ago

Verified 9f7add1c

mmap: add include for cerrno (#11296)

mascguy committed 354 days ago

Verified 90d987b1

cmake: fix shell command quoting in build-info script (#11309)

Xarbirus committed 354 days ago

Verified a4251edd

llama : add support for Deepseek-R1-Qwen distill model (#11310)

ngxson committed 354 days ago

Verified ec7f3ac9

cont : fix whitespaces (#11305)

ggerganov committed 354 days ago

Verified ef6dada6

llama : re-add LLM_ARCH_PHIMOE (#11305)

KyleBruene committed 354 days ago

Verified ae3c1db2

tests : increase timeout when sanitizers are enabled (#11300)

ggerganov committed 355 days ago

Verified 92bc4939

Older