ngxson/llama.cpp

Pull Requests Commits

fix std::remove_if

ngxson committed 1 year ago

0244e797

ngxson committed 1 year ago

b9e51710

fix recv_with_timeout

ngxson committed 1 year ago

08296ec7

server : add more clean up when cancel_tasks is called

ngxson committed 1 year ago

f4dab52a

Add Jinja template support (#11016)

ochafik committed 1 year ago

Verified 6171c9d2

export-lora : fix tok_embd tensor (#11330)

ngxson committed 1 year ago

Verified e28245f3

rpc : better caching of the base buffer pointer (#11331)

rgerganov committed 1 year ago

Verified 6da5bec8

linenoise.cpp refactoring (#11301)

ericcurtin committed 1 year ago

Verified 2e2f8f09

metal : fix out-of-bounds write (#11314)

ggerganov committed 1 year ago

Verified 2139667e

common : add -hfd option for the draft model (#11318)

ggerganov committed 1 year ago

Verified 80d0d6b4

vulkan: fix coopmat2 validation failures (#11284)

jeffbolznv committed 1 year ago

Verified aea8ddd5

examples : fix add_special conditions (#11311)

ggerganov committed 1 year ago

Verified 9f7add1c

mmap: add include for cerrno (#11296)

mascguy committed 1 year ago

Verified 90d987b1

cmake: fix shell command quoting in build-info script (#11309)

Xarbirus committed 1 year ago

Verified a4251edd

llama : add support for Deepseek-R1-Qwen distill model (#11310)

ngxson committed 1 year ago

Verified ec7f3ac9

cont : fix whitespaces (#11305)

ggerganov committed 1 year ago

Verified ef6dada6

llama : re-add LLM_ARCH_PHIMOE (#11305)

KyleBruene committed 1 year ago

Verified ae3c1db2

tests : increase timeout when sanitizers are enabled (#11300)

ggerganov committed 1 year ago

Verified 92bc4939

simple-chat : fix BOS being added to each message (#11278)

ggerganov committed 1 year ago

Verified b9daaffe

SYCL: Introducing memory host pool (#11251)

s-Nick committed 1 year ago

Verified 99487b57

Adding linenoise.cpp to llama-run (#11252)

ericcurtin committed 1 year ago

Verified a1649cc1

cmake : add sanitizer flags for llama.cpp (#11279)

ggerganov committed 1 year ago

Verified 4dd34ff8

server : implement cancellable request (#11285)

ngxson committed 1 year ago

Verified f30f0992

scripts : restore hf.sh (#11288)

ggerganov committed 1 year ago

Verified f26c8741

tts : add guide tokens support (#11186)

LostRuins committed 1 year ago

Verified 6390a998

vulkan: fix coopmat2 flash attention for non-contiguous inputs (#11281)

jeffbolznv committed 1 year ago

Verified 44e18ef9

llama.android: add field formatChat to control whether to parse special tokens when send message (#11270)

codezjx committed 1 year ago

Verified 3edfa7d3

rpc : early register backend devices (#11262)

rgerganov committed 1 year ago

Verified 667d7284

vocab : fix double-eos check (#11273)

ggerganov committed 1 year ago

Verified a133566d

llama : fix deprecation message: vocabable -> vocab (#11269)

dwrensha committed 1 year ago

Verified 960ec652

Older