ngxson/llama.cpp

Pull Requests Commits

fix i underflow

ngxson committed 1 year ago

06dfcdfc

ngxson committed 1 year ago

c318e0f2

ngxson committed 1 year ago

bdc22d60

server : implement cancellable request

ngxson committed 1 year ago

8ebe9b23

llama.android: add field formatChat to control whether to parse special tokens when send message (#11270)

codezjx committed 1 year ago

Verified 3edfa7d3

rpc : early register backend devices (#11262)

rgerganov committed 1 year ago

Verified 667d7284

vocab : fix double-eos check (#11273)

ggerganov committed 1 year ago

Verified a133566d

llama : fix deprecation message: vocabable -> vocab (#11269)

dwrensha committed 1 year ago

Verified 960ec652

README : added kalavai to infrastructure list (#11216)

musoles committed 1 year ago

Verified 7a689c41

vulkan: support copy from f32 to q4_0/q4_1/q5_0/q5_1/q8_0/iq4_nl (#11166)

jeffbolznv committed 1 year ago

Verified bd38ddea

vulkan: optimize coopmat2 q4_k/q5_k dequant functions. (#11206)

jeffbolznv committed 1 year ago

Verified 466300fe

vulkan: optimize coopmat2 q2_k dequant function (#11130)

jeffbolznv committed 1 year ago

Verified 206bc534

llama : add internlm3 support (#11233)

RunningLeon committed 1 year ago

Verified 4dbc8b9c

CUDA: backwards pass for misc. ops, add tests (#11257)

JohannesGaessler committed 1 year ago

Verified 9c8dcefe

llama : add `llama_model_load_from_splits` (#11255)

ngxson committed 1 year ago

Verified 681149ce

ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (#11227)

fj-y-saito committed 1 year ago

Verified c67cc983

vulkan: scale caching for k quants + misc fixes (#11081)

netrunnereve committed 1 year ago

Verified adc5dd92

ci : use -no-cnv in gguf-split tests (#11254)

ggerganov committed 1 year ago

Verified f11cfdfd

fix: ggml: fix vulkan-shaders-gen build (#10448)

sparkleholic committed 1 year ago

Verified 1d850433

RoPE: fix back, CUDA support for back + noncont. (#11240)

JohannesGaessler committed 1 year ago

Verified 432df2d5

examples : add embd_to_audio to tts-outetts.py [no ci] (#11235)

danbev committed 1 year ago

Verified 0ccd7f3e

SYCL: Add gated linear attention kernel (#11175)

qnixsynapse committed 1 year ago

Verified f446c2cf

ci : add -no-cnv for tests (#11238)

ngxson committed 1 year ago

Verified b4d92a59

vocab : add dummy tokens for "no_vocab" type (#11231)

ggerganov committed 1 year ago

Verified bbf3e55e

server : Improve code snippets direction between RTL text (#11221)

ebraminio committed 1 year ago

Verified c5bf0d1b

Refactor test-chat-template.cpp (#11224)

ochafik committed 1 year ago

Verified 091592d7

ggerganov committed 1 year ago

Verified 44d1e796

scripts : sync gguf (cont)

ggerganov committed 1 year ago

Verified a4f3f5d8

scripts : sync gguf

ggerganov committed 1 year ago

Verified 48e1ae0e

scripts : sync opencl

ggerganov committed 1 year ago

Verified d00a80e8

Older