ngxson/llama.cpp

Pull Requests Commits

set_position_mrope_1d rm n_tokens

ngxson committed 209 days ago

27a8f266

rm redundant code

ngxson committed 209 days ago

05310968

Merge branch 'master' into xsn/qwen25omni

ngxson committed 209 days ago

baa882a5

llama : validate seq id batch input (#13809)

ggerganov committed 209 days ago

Verified 4f81b33e

server: --offline mode (#13804)

ochafik committed 209 days ago

Verified cdf94a18

scripts : add option to compare commits in Debug (#13806)

ggerganov committed 209 days ago

Verified a26c4cc1

cuda : avoid cuGetErrorString (#13791)

ggerganov committed 209 days ago

Verified 4265a87b

SYCL: Add non contiguous support in RMS_NORM and NORM kernels (#13611)

qnixsynapse committed 209 days ago

Verified 6f180b91

server: fix streaming crashes (#13786)

ochafik committed 209 days ago

Verified 03f582ae

examples/training: Fix file name in README (#13803)

standby24x7 committed 209 days ago

Verified 88c125f2

`server`: fix format of streamed tool call deltas (diff name, fix id location) (#13800)

ochafik committed 209 days ago

Verified d74e94c1

server: fix regression on streamed non-chat completion w/ stops (#13785)

ochafik committed 209 days ago

Verified f13847cf

examples : allow extracting embeddings from decoder contexts (#13797)

ggerganov committed 210 days ago

Verified 79c137f7

llama : clarify deprecation message (#13794)

ggerganov committed 210 days ago

Verified 22229314

fix test case "huge"

ngxson committed 210 days ago

94d893d6

ngxson committed 210 days ago

ef48e8f2

fix tokenizing with add_special

ngxson committed 210 days ago

d03c2407

ngxson committed 210 days ago

bf34f38f

add test for 3B

ngxson committed 210 days ago

235fbdbf

ngxson committed 210 days ago

6e65e0c5

refactor if..else to switch

ngxson committed 210 days ago

346d2522

more strict validate of n_embd

ngxson committed 210 days ago

90132453

sycl: Add more debug prints (#13640)

Rbiessy committed 210 days ago

Verified 9012eb9b

ngxson committed 210 days ago

1ac73f40

first working version

ngxson committed 210 days ago

24ec43eb

vulkan: mark IM2COL as supporting non-contig (#13783)

jeffbolznv committed 210 days ago

Verified fef693dc

CANN: Add the basic supports of Flash Attention kernel (#13627)

shibizhao committed 210 days ago

Verified 2d38b6e4

`server`: add `--reasoning-budget 0` to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771)

ochafik committed 210 days ago

Verified e121edc4

ok, missing SinusoidsPositionEmbedding

ngxson committed 210 days ago

8b51e7fa

ngxson committed 210 days ago

bb92d1d0

Older