PR #23485 server: add margin for draft model for `fit`

server: add margin for draft model for `fit` #23485

am17an merged 3 commits into ggml-org:master from am17an:am17an/fix-fit-mtp-oom

am17an requested a review 36 days ago

am17an requested a review from

JohannesGaessler 36 days ago

bartowski1182 commented on 2026-05-21

github-actions added examples

github-actions added server

server: add margin for draft model for `fit`

ac0a2350

am17an force pushed from 0b2f2461 to ac0a2350 35 days ago

clarify worst case memory usage for MTP context

47112993

JohannesGaessler commented on 2026-05-22

use params.devices if not empty

da51d57b

JohannesGaessler approved these changes on 2026-05-24

ServeurpersoCom approved these changes on 2026-05-24

am17an merged 83eebe9d into master 33 days ago

Reviewers

ServeurpersoCom

JohannesGaessler

bartowski1182

Assignees

No one assigned

Labels

examples server

Milestone

No milestone