ggerganov/llama.cpp

Pull Requests Commits

graph : add comments

ggerganov committed 251 days ago

Verified 624f7bd0

graph : move non-context related logic to llm_build_context

ggerganov committed 251 days ago

Verified 0f7daa9d

cont : migrate the rest of the inputs out of llama_context

ggerganov committed 251 days ago

Verified 9cab53c7

context : decouple inputs, llama_graph_i become const (WIP)

ggerganov committed 251 days ago

Verified 7f02ee56

llama : introduce concept of llama_memory

ggerganov committed 252 days ago

Verified 38db8a58

kv-cache : basic abstraction

ggerganov committed 252 days ago

Verified 828effd9

Merge branch 'master' into gg/llama-kv-cache

ggerganov committed 253 days ago

Verified 82675a01

context : disable encoder embd tensor for now

ggerganov committed 253 days ago

Verified 952feedf

cmake: Fix ggml backend dependencies and installation (#11818)

vvuksanovic committed 253 days ago

Verified b95c8af3

llava : add struct for FFI bindgen (#12079)

tinglou committed 253 days ago

Verified a800ae46

Refactor gguf scripts to improve metadata handling (#11909)

CISC committed 254 days ago

Verified 69050a11

gguf-py: enable reading non-native endian files (#12081)

AlekseiNikiforovIBM committed 254 days ago

Verified 3567ee3a

readme : update infra list (#9096)

kerthcet committed 254 days ago

Verified 53e4db10

docs: add docs/function-calling.md to lighten server/README.md's plight (#12069)

ochafik committed 254 days ago

Verified d7cfe1ff

vulkan: fix assertion when qy_needs_dequant (#12068)

jeffbolznv committed 254 days ago

Verified a82c9e7c

context : pass embeddings tensor from encoder to decoder

ggerganov committed 254 days ago

Verified 4efe9898

server: handle echo=false on /v1/completions (#12060)

rhjdvsgsgks committed 255 days ago

Verified 401af80b

add OP sigmoid (#12056)

foldl committed 255 days ago

Verified c132239b

ggml-cpu: Fix build with sve (#12059)

MollySophia committed 255 days ago

Verified 393fca62

vulkan: implement more backpropagation operators (#11914)

remyoudompheng committed 255 days ago

Verified 61d4f39d

server: support add_generation_prompt query param (#12062)

ochafik committed 255 days ago

Verified 0b527456

context : fix enc-dec state save/load

ggerganov committed 255 days ago

Verified e2b3294f

context : enc-dec is now working

ggerganov committed 255 days ago

Verified e5bc5f8e

Add Doc for Converting Granite Vision -> GGUF (#12006)

alex-jw-brooks committed 255 days ago

Verified 4d1051a4

llama : expose llama_model_n_head_kv in the API (#11997)

vlovich committed 255 days ago

Verified 3e9a2860

metal : copy kernels for quant to F32/F16 conversions (#12017)

gcp committed 255 days ago

Verified 58d07a80

opencl: fix for small models (#11950)

lhez committed 255 days ago

Verified 34a846b5

enc-dec : compose wip

ggerganov committed 255 days ago

Verified be58e300

llava : Add Granite Vision Support (#11794)

alex-jw-brooks committed 255 days ago

Verified 7a2c913e

[SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035)

NeoZhangJianyu committed 255 days ago

Verified 08d59862

Older