llama.cpp
5b279754 - lookup : fix token positions in the draft batch

Commit

2 years ago

lookup : fix token positions in the draft batch

References

#4484 - Prompt lookup decoding

Author

ggerganov

ggerganov

Parents

Loading