ochafik/llama.cpp

Pull Requests Commits

`json`: DRAFT decimal bounds support

ochafik committed 1 year ago

7752087c

[CANN] Adapt to dynamically loadable backends mechanism (#9970)

leo-pony committed 1 year ago

Verified 6b844735

arg : fix typo in embeddings argument help [no ci] (#9994)

danbev committed 1 year ago

Verified 674804a9

llama.vim : fix info text display [no ci] (#9787)

ggerganov committed 1 year ago

Verified e94a138d

llama.vim : move info to the right of screen [no ci] (#9787)

ggerganov committed 1 year ago

Verified e01c67af

readme : update UI list (#9972)

a-ghorbani committed 1 year ago

Verified 994cfb1a

arg : fix attention non-causal arg value hint (#9985)

danbev committed 1 year ago

Verified 94008cc7

llama.vim : plugin for Neovim (#9787)

ggerganov committed 1 year ago

Verified dbd5f2f5

ggml : add asserts for type conversion in fattn kernels (#9971)

ggerganov committed 1 year ago

Verified f594bc80

rpc : pack only RPC structs (#9959)

rgerganov committed 1 year ago

Verified d5ebd79c

llama : default sampling changes + greedy update (#9897)

ggerganov committed 1 year ago

Verified 55e47786

speculative : fix handling of some input params (#9963)

ggerganov committed 1 year ago

Verified bc219750

fix mul_mat_vec_q and *_vec_q error (#9939)

NeoZhangJianyu committed 1 year ago

Verified 1db8c84f

readme : update bindings list (#9951)

lcarrere committed 1 year ago

Verified 45f09764

readme : update infra list (#9942)

icppWorld committed 1 year ago

Verified 7cab2083

llama : remove all_pos_0, all_pos_1, all_seq_id from llama_batch (#9745)

ngxson committed 1 year ago

Verified cda0e4b6

rpc : backend refactoring (#9912)

rgerganov committed 1 year ago

Verified afd9909a

[SYCL] Add SYCL Backend registry, device and Event Interfaces (#9705)

OuadiElfarouki committed 1 year ago

Verified 87421a23

add amx kernel for gemm (#8998)

mingfeima committed 1 year ago

Verified 60ce97c9

server : add n_indent parameter for line indentation requirement (#9929)

ggerganov committed 1 year ago

Verified 8901755b

llama : rename batch_all to batch (#8881)

danbev committed 1 year ago

Verified 6f55bccb

readme : remove --memory-f32 references (#9925)

ggerganov committed 1 year ago

Verified 17bb9280

llama : change warning to debug log

ggerganov committed 1 year ago

Verified 9f45fc1e

llama : infill sampling handle very long tokens (#9924)

ggerganov committed 1 year ago

Verified 99bd4ac2

readme : update bindings list (#9918)

ShenghaiWang committed 1 year ago

Verified 3752217e

vulkan : add backend registry / device interfaces (#9721)

slaren committed 1 year ago

Verified f010b77a

fix: allocating CPU buffer with size `0` (#9917)

giladgd committed 1 year ago

Verified 21942002

fix: use `vm_allocate` to allocate CPU backend buffer on macOS (#9875)

giladgd committed 1 year ago

Verified 73afe681

llama : suppress conversion from 'size_t' to 'int' (#9046)

danbev committed 1 year ago

Verified 9e041024

llava : fix typo in error message [no ci] (#9884)

danbev committed 1 year ago

Verified dbf18e4d

Older