ngxson/llama.cpp

Pull Requests Commits

set_position_mrope_1d rm n_tokens

ngxson committed 1 year ago

27a8f266

rm redundant code

ngxson committed 1 year ago

05310968

Merge branch 'master' into xsn/qwen25omni

ngxson committed 1 year ago

baa882a5

llama : validate seq id batch input (#13809)

ggerganov committed 1 year ago

Verified 4f81b33e

server: --offline mode (#13804)

ochafik committed 1 year ago

Verified cdf94a18

scripts : add option to compare commits in Debug (#13806)

ggerganov committed 1 year ago

Verified a26c4cc1

cuda : avoid cuGetErrorString (#13791)

ggerganov committed 1 year ago

Verified 4265a87b

SYCL: Add non contiguous support in RMS_NORM and NORM kernels (#13611)

qnixsynapse committed 1 year ago

Verified 6f180b91

server: fix streaming crashes (#13786)

ochafik committed 1 year ago

Verified 03f582ae

examples/training: Fix file name in README (#13803)

standby24x7 committed 1 year ago

Verified 88c125f2

`server`: fix format of streamed tool call deltas (diff name, fix id location) (#13800)

ochafik committed 1 year ago

Verified d74e94c1

server: fix regression on streamed non-chat completion w/ stops (#13785)

ochafik committed 1 year ago

Verified f13847cf

examples : allow extracting embeddings from decoder contexts (#13797)

ggerganov committed 1 year ago

Verified 79c137f7

llama : clarify deprecation message (#13794)

ggerganov committed 1 year ago

Verified 22229314

fix test case "huge"

ngxson committed 1 year ago

94d893d6

ngxson committed 1 year ago

ef48e8f2

fix tokenizing with add_special

ngxson committed 1 year ago

d03c2407

ngxson committed 1 year ago

bf34f38f

add test for 3B

ngxson committed 1 year ago

235fbdbf

ngxson committed 1 year ago

6e65e0c5

refactor if..else to switch

ngxson committed 1 year ago

346d2522

more strict validate of n_embd

ngxson committed 1 year ago

90132453

sycl: Add more debug prints (#13640)

Rbiessy committed 1 year ago

Verified 9012eb9b

ngxson committed 1 year ago

1ac73f40

first working version

ngxson committed 1 year ago

24ec43eb

vulkan: mark IM2COL as supporting non-contig (#13783)

jeffbolznv committed 1 year ago

Verified fef693dc

CANN: Add the basic supports of Flash Attention kernel (#13627)

shibizhao committed 1 year ago

Verified 2d38b6e4

`server`: add `--reasoning-budget 0` to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771)

ochafik committed 1 year ago

Verified e121edc4

ok, missing SinusoidsPositionEmbedding

ngxson committed 1 year ago

8b51e7fa

ngxson committed 1 year ago

bb92d1d0

Older