PR #9963 speculative : fix batch sizes at initialization

speculative : fix batch sizes at initialization #9963

ggerganov merged 3 commits into master from gg/speculative-fixes

speculative : fix batch sizes at initialization

47bb241c

github-actions added examples

ggerganov requested a review from

slaren 1 year ago

slaren approved these changes on 2024-10-20

speculative : handle params.n_predict == -1

67d18498

speculative : limit batch size to llama_n_batch

90ab8a10

ggerganov merged bc219750 into master 1 year ago

ggerganov deleted the gg/speculative-fixes branch 1 year ago

Reviewers

slaren

Assignees

No one assigned

Labels

examples

Milestone

No milestone