ngxson/llama.cpp

Pull Requests Commits

Merge branch 'master' into xsn/lighton-ocr

ngxson committed 120 days ago

4718203a

ngxson committed 120 days ago

62cc684b

llama: fix leaked buffers for mmap + split files (#16765)

JohannesGaessler committed 120 days ago

Verified 945501f5

test-backend-ops: print failed tests at the end (#16785)

am17an committed 120 days ago

Verified 75cbdd3f

sycl: add ROLL operation support (#16665)

tamarPal committed 120 days ago

Verified 2b9bd9bf

sycl: add REPEAT_BACK operation support (#16734)

shani-f committed 120 days ago

Verified 59fc1ec8

CUDA: support for weight clamp in top-k norm (#16702)

am17an committed 120 days ago

Verified 75d33b93

ggml-alloc : make gallocr prefer chunks that allow memory reuse (#16788)

Acly committed 120 days ago

Verified 3470a5c8

cuda : use fast copy when src and dst are of different type and contiguous (#16789)

CISC committed 121 days ago

Verified bd562fe4

ggml: fix cuda kernel launch configuration for k_compute_batched_ptrs to support large batch (#16744)

leejet committed 121 days ago

Verified bbac6a26

convert : enable expert group selection for all models with it (#16691)

CISC committed 121 days ago

Verified 73a48c97

graph : add clamping to ffn_moe_weights_sum to avoid div-by-zero (#16655)

CISC committed 121 days ago

Verified f696428c

model : set res->t_embd in SmallThinker models (#16782)

CISC committed 121 days ago

Verified 7cce4f81

docs : add Jamba to Text-only models list (#16778)

amirai21 committed 121 days ago

Verified 8d886282

CUDA: General GEMV fusion (#16715)

am17an committed 121 days ago

Verified f77c13b9

vulkan: deduplicate Microsoft Direct3D12 devices (#16689)

giladgd committed 121 days ago

Verified 3cfa9c3f

convert : handle mmproj filename/path properly (#16760)

Galunid committed 122 days ago

Verified 5d195f17

model : set res->t_embd in PLaMo2 models (#16766)

mitmul committed 122 days ago

Verified 226f295f

vulkan: delete dead code (#16732)

giuseppe committed 122 days ago

Verified f90b4a8e

vulkan: Optimize SSM_SCAN (#16645)

jeffbolznv committed 122 days ago

Verified 8423d019

convert : avoid dequantizing mxfp4 for GPT-OSS (#16756)

compilade committed 122 days ago

Verified 5cca2542

model : add LightOnOCR-1B model

ngxson committed 122 days ago

a51c6b13

ggml: fix CUDA grid launch condition for large block_nums.y in binbcast (#16742)

leejet committed 123 days ago

Verified 55945d2e

CUDA: use CUB for arbitary size argsort (#16754)

am17an committed 123 days ago

Verified 0bcb40b4

webui: support q URL parameter (#16728)

odrling committed 123 days ago

Verified 69e9ff01

model-conversion : add trust_remote_code for orig model run [no ci] (#16751)

danbev committed 123 days ago

Verified 5a91109a

convert : handle pre-quantized models (#14810)

compilade committed 124 days ago

Verified f8f071fa

server: add memory breakdown print (#16740)

JohannesGaessler committed 124 days ago

Verified 0bf47a1d

convert : Make mistral-common dependency optional (#16738)

juliendenize committed 124 days ago

Verified dd62dcfa

mtmd-cli : allow using --jinja (#16718)

ngxson committed 124 days ago

Verified d0660f23

Older