PR #4959 Speculative: threading options

Speculative: threading options #4959

ggerganov merged 5 commits into ggml-org:master from stduhpf:speculative_threading

speculative: expose draft threading

92edbe48

fix usage format

fd8090b7

accept -td and -tbd args

49cbf3ec

speculative: revert default behavior when -td is unspecified

f4fe6333

fix trailing whitespace

78d9bd6a

ggerganov approved these changes on 2024-01-16

ggerganov merged e0324285 into master 2 years ago

stduhpf deleted the speculative_threading branch 2 years ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone