ggerganov/llama.cpp

Pull Requests Commits

ngxson committed 46 days ago

b7d9c4cc

ngxson committed 46 days ago

27615964

ngxson committed 46 days ago

ef51649a

fix flush before reset()

ngxson committed 46 days ago

a46d5259

ngxson committed 46 days ago

c53ad201

ngxson committed 46 days ago

9138c133

refactor server_task_result_metrics

ngxson committed 46 days ago

9c57fd78

metrics: seperate cache/processed prompt tokens

ngxson committed 46 days ago

e0f113de

metrics_flush_idle

ngxson committed 46 days ago

a55abe44

metrics_on_prediction

ngxson committed 46 days ago

6849901f

n_predict --> n_gen

ngxson committed 46 days ago

509866bc

more accurate batch metrics tracking

ngxson committed 46 days ago

372ea573

exclude first generated token

ngxson committed 46 days ago

20ce1267

nits: move place in code

ngxson committed 46 days ago

a2fd44e3

ngxson committed 46 days ago

2581e568

tie stats to batch

ngxson committed 46 days ago

7d59fa38

rm result_timings

ngxson committed 46 days ago

75d2de4b

ngxson committed 46 days ago

b16f898b

move most fields to server_slot_stats

ngxson committed 46 days ago

22170592

server: refactor metrics

ngxson committed 46 days ago

14bb119b

Address review comment of PR 25532 (#26852)

gaugarg-nv committed 47 days ago

Verified 030ebb55

opencl: transpose the K tile in local memory for FA prefill kernels (#26428)

wanghqc committed 47 days ago

Verified 689e227d

ci : target ROCm 7.14 for build and release (#25775)

superm1 committed 47 days ago

Verified 0666ad2b

llama : support multi-output backend sampling (#25532)

gaugarg-nv committed 48 days ago

Verified dd1ea524

ggml-cpu : fix CPU affinity mask being ignored on Android (#26838)

hiteshchopra11 committed 48 days ago

Verified d2f83055

ggml : require contiguous src for ROLL on CUDA and Metal (#25928)

devYRPauli committed 48 days ago

Verified f8def7fe

ui: UI/chat form follow ups (#26743)

ServeurpersoCom committed 48 days ago

Verified 4dee52f8

ci : don't specify python version in server-sanitize for broader runner compatibility (#26840)

CISC committed 48 days ago

Verified e5275f6f

server: add more tool isolation support (ssh remote + podman rootless) (#26774)

ServeurpersoCom committed 48 days ago

Verified 4ae84dea

model: Muse Glimmer Support (#26841)

pcuenca committed 48 days ago

Verified 62bf73d2

Older