ngxson/llama.cpp

Pull Requests Commits

missing include

ngxson committed 1 year ago

c22806dd

simplify logic for llava-1.5

ngxson committed 1 year ago

1395a4ad

refactor llava-1.6 preprocessing

ngxson committed 1 year ago

dd08673a

clip : refactor, add `image_manipulation` and `llava_uhd`

ngxson committed 1 year ago

13e5f593

mtmd : add methods to access `mtmd_image_tokens` (#12906)

ngxson committed 1 year ago

Verified b9154ecf

rpc : add RPC_CMD_HELLO (#12955)

rgerganov committed 1 year ago

Verified 2db9ba14

graph : make FA compatible with MLA + add initial Metal kernels (#12953)

ggerganov committed 1 year ago

Verified 2f74c354

ggml: Re-enable CUDA graphs in presence of CONT and DUP nodes (#12970)

agray3 committed 1 year ago

Verified 207c22ec

CANN: Add support for async operator submission (#12864)

hipudding committed 1 year ago

Verified 7a395f67

llama : recognize IBM Granite 3.3 FIM tokens (#12988)

Noeda committed 1 year ago

Verified 971f245b

opencl: fix incorrect local_size index in profiling log (#12868)

kimminsu38oo committed 1 year ago

Verified 12b17501

vulkan: enable coopmat2 FA gqa and split_k optimizations more often (#12931)

jeffbolznv committed 1 year ago

Verified 015022bb

CANN: Add 310P operator support check (#12962)

noemotiovon committed 1 year ago

Verified b43d89e3

opencl: split `ggml-opencl.cl` into multiple files and cleanup (#12886)

lhez committed 1 year ago

Verified 80f19b41

metal : add FA-vec kernels for head size 96 (#12952)

ggerganov committed 1 year ago

Verified f8f820cc

CANN: Add x86 build ci (#12950)

hipudding committed 1 year ago

Verified 54a72720

CUDA/HIP: Share the same unified memory allocation logic. (#12934)

hjc4869 committed 1 year ago

Verified 84778e97

SYCL: Add ROPE vision kernel (#12887)

qnixsynapse committed 1 year ago

Verified 51067647

llama : DeepSeek V2/V3 MLA implementation (#12801)

jukofyork committed 1 year ago

Verified daa42288

ggml : Add AVX512 implementation of GEMM - Q4_Kx8 (#12829)

Srihari-mcw committed 1 year ago

Verified eccc7a16

CANN: Opt ROPE optimization (#12865)

noemotiovon committed 1 year ago

Verified 0019279b

CANN: Optimize CANN buffer pool memory management (#12875)

bachelor-dou committed 1 year ago

Verified b0c75ac9

Add performance print for gemma3 in example (#12929)

Russyyds committed 1 year ago

Verified d6d2c2ab

SYCL: Fix im2col (#12910)

qnixsynapse committed 1 year ago

Verified 75afa0ae

rpc : use ggml_context_ptr (#12938)

rgerganov committed 1 year ago

Verified c772d549

dsiable curl lib check, this action is missed by commit bd3f59f81289b920bcc597a208c14f55e39ed37e (#12761) (#12937)

NeoZhangJianyu committed 1 year ago

Verified 81c7e64f

ggerganov committed 1 year ago

526739b8

cpu: fix cpu backend's supports-op for GET_ROWS_BACK. fixes a fatal when running test-backend-ops with only the CPU backend (ggml/1190)

cmdr2 committed 1 year ago

a25355e2

ggml: use _mm[512/256]_dpbusd[_avx]_epi32 to directly accumulate into the result register (#12773)

SongXiaoXi committed 1 year ago

Verified e959d32b

ggml: disable CUDA graphs for unsupported DUP and CONT node types (#12891)

agray3 committed 1 year ago

Verified 307bfa25

Older