PR #23287 Move to backend sampling for MTP draft path

Move to backend sampling for MTP draft path #23287

gaugarg-nv merged 3 commits into ggml-org:master from gaugarg-nv:mtp_backend_sampling

gaugarg-nv requested a review from

ggerganov 123 days ago

gaugarg-nv requested a review 123 days ago

gaugarg-nv requested a review from

am17an 123 days ago

gaugarg-nv force pushed 122 days ago

ggerganov commented on 2026-05-19

ggerganov assigned

ggerganov 121 days ago

Move to backend sampling for MTP draft path

e20085ba

Allow sampler chains to be partially offloaded to backend

e961ca57

Add --spec-draft-backend-sampling argument. Enabled by default.

b0061f7f

gaugarg-nv force pushed to b0061f7f 121 days ago

ggerganov approved these changes on 2026-05-20

am17an approved these changes on 2026-05-20

gaugarg-nv merged ad277572 into master 121 days ago

gaugarg-nv deleted the mtp_backend_sampling branch 111 days ago

Reviewers

am17an

ggerganov

Assignees

ggerganov

Labels

None yet

Milestone

No milestone