ggml-org/llama.cpp

Pull Requests Commits

context : round n_tokens to next multiple of n_seqs when reserving

compilade committed 1 year ago

4b6fb652

Implement GGML_CPU_ALL_VARIANTS for ARM (#14080)

ckastner committed 1 year ago

Verified 532802f9

chore : clean up relative source dir paths (#14128)

CISC committed 1 year ago

Verified d4e0d95c

tests : add test-tokenizers-repo (#14017)

CISC committed 1 year ago

Verified cc66a7f7

vulkan: Better thread-safety for command pools/buffers (#14116)

jeffbolznv committed 1 year ago

Verified bd248d4d

webui: Wrap long numbers instead of infinite horizontal scroll (#14062)

am17an committed 1 year ago

Verified 7781e5fe

kv-cache : relax SWA masking condition (#14119)

ggerganov committed 1 year ago

Verified 89a184fa

server : pass default --keep argument (#14120)

MightyAlex200 committed 1 year ago

Verified 2baf0772

kv-cache : add LLAMA_KV_CACHE_DEBUG environment variable (#14121)

ggerganov committed 1 year ago

Verified 7ae29321

vulkan: Track descriptor pools/sets per-context (#14109)

jeffbolznv committed 1 year ago

Verified 1f7d50b2

opencl: add `mul_mv_id_q4_0_f32_8x_flat` (#14003)

lhez committed 1 year ago

Verified 4c763c8d

kv-cache : avoid modifying recurrent cells when setting inputs (#13834)

compilade committed 1 year ago

Verified dad5c443

convert : fix duplicate key DeepSeek-R1 conversion error (#14103)

CISC committed 1 year ago

Verified 55f6b9fa

llama : support GEGLU for jina-bert-v2 (#14090)

CISC committed 1 year ago

Verified 3678b838

vulkan: force device 0 in CI (#14106)

jeffbolznv committed 1 year ago

Verified 652b70e6

Fixed spec timings to: accepted/tested instead of accepted/drafted (#14104)

jukofyork committed 1 year ago

Verified 3a12db23

ggerganov committed 1 year ago

ae92c185

ggml : fix weak alias win32 (whisper/0)

ggerganov committed 1 year ago

b7ce1ad1

Vulkan: Don't default to CPU device (like llvmpipe), even if no other device is available, to allow fallback to CPU backend (#14099)

0cc4m committed 1 year ago

Verified 97340b4c

rpc : nicer error messages for RPC server crash (#14076)

isaac-mcfadyen committed 1 year ago

Verified 2bb04670

ggerganov committed 1 year ago

b8e2194e

Add in-build ggml::ggml ALIAS library (ggml/1260)

dg0yt committed 1 year ago

1a3b5e80

metal : use less stack memory in FA kernel (#14088)

ggerganov committed 1 year ago

Verified 1f63e75f

kv-cache : fix shift and defrag logic (#14081)

ggerganov committed 1 year ago

Verified 40cbf571

llama : allow building all tests on windows when not using shared libs (#13980)

slaren committed 1 year ago

Verified 7f4fbe51

ggml-cpu : split arch-specific implementations (#13892)

xctan committed 1 year ago

Verified f470bc36

cuda : fix device sync on buffer clear (#14033)

slaren committed 1 year ago

Verified 8f47e25f

graph : fix geglu (#14077)

ggerganov committed 1 year ago

Verified 201b31dc

CANN: Simplify the environment variable setting(#13104)

bachelor-dou committed 1 year ago

Verified e21d2d4a

webui: fix sidebar being covered by main content (#14082)

yeahdongcn committed 1 year ago

Verified dc0623fd

Older