ggerganov/llama.cpp

Pull Requests Commits

llama : re-add LLM_ARCH_PHIMOE (#11305)

KyleBruene committed 1 year ago

Verified ae3c1db2

tests : increase timeout when sanitizers are enabled (#11300)

ggerganov committed 1 year ago

Verified 92bc4939

simple-chat : fix BOS being added to each message (#11278)

ggerganov committed 1 year ago

Verified b9daaffe

SYCL: Introducing memory host pool (#11251)

s-Nick committed 1 year ago

Verified 99487b57

Adding linenoise.cpp to llama-run (#11252)

ericcurtin committed 1 year ago

Verified a1649cc1

cmake : add sanitizer flags for llama.cpp (#11279)

ggerganov committed 1 year ago

Verified 4dd34ff8

server : implement cancellable request (#11285)

ngxson committed 1 year ago

Verified f30f0992

scripts : restore hf.sh (#11288)

ggerganov committed 1 year ago

Verified f26c8741

tts : add guide tokens support (#11186)

LostRuins committed 1 year ago

Verified 6390a998

vulkan: fix coopmat2 flash attention for non-contiguous inputs (#11281)

jeffbolznv committed 1 year ago

Verified 44e18ef9

llama.android: add field formatChat to control whether to parse special tokens when send message (#11270)

codezjx committed 1 year ago

Verified 3edfa7d3

rpc : early register backend devices (#11262)

rgerganov committed 1 year ago

Verified 667d7284

vocab : fix double-eos check (#11273)

ggerganov committed 1 year ago

Verified a133566d

llama : fix deprecation message: vocabable -> vocab (#11269)

dwrensha committed 1 year ago

Verified 960ec652

README : added kalavai to infrastructure list (#11216)

musoles committed 1 year ago

Verified 7a689c41

vulkan: support copy from f32 to q4_0/q4_1/q5_0/q5_1/q8_0/iq4_nl (#11166)

jeffbolznv committed 1 year ago

Verified bd38ddea

vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (#11206)

jeffbolznv committed 1 year ago

Verified 466300fe

vulkan: optimize coopmat2 q2_k dequant function (#11130)

jeffbolznv committed 1 year ago

Verified 206bc534

llama : add internlm3 support (#11233)

RunningLeon committed 1 year ago

Verified 4dbc8b9c

CUDA: backwards pass for misc. ops, add tests (#11257)

JohannesGaessler committed 1 year ago

Verified 9c8dcefe

llama : add `llama_model_load_from_splits` (#11255)

ngxson committed 1 year ago

Verified 681149ce

ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (#11227)

fj-y-saito committed 1 year ago

Verified c67cc983

vulkan: scale caching for k quants + misc fixes (#11081)

netrunnereve committed 1 year ago

Verified adc5dd92

ci : use -no-cnv in gguf-split tests (#11254)

ggerganov committed 1 year ago

Verified f11cfdfd

fix: ggml: fix vulkan-shaders-gen build (#10448)

sparkleholic committed 1 year ago

Verified 1d850433

RoPE: fix back, CUDA support for back + noncont. (#11240)

JohannesGaessler committed 1 year ago

Verified 432df2d5

examples : add embd_to_audio to tts-outetts.py [no ci] (#11235)

danbev committed 1 year ago

Verified 0ccd7f3e

SYCL: Add gated linear attention kernel (#11175)

qnixsynapse committed 1 year ago

Verified f446c2cf

ci : add -no-cnv for tests (#11238)

ngxson committed 1 year ago

Verified b4d92a59

vocab : add dummy tokens for "no_vocab" type (#11231)

ggerganov committed 1 year ago

Verified bbf3e55e

Newer Older