speculative : add --draft CLI arg - SemanticDiff

Commit

2 years ago

speculative : add --draft CLI arg

References

#2926 - speculative : PoC for speeding-up inference via speculative sampling

Author

ggerganov

ggerganov

Parents

Loading