llama.cpp
2b8830af - examples : do not eval prompt 2 times (close #3348)

Commit

2 years ago

examples : do not eval prompt 2 times (close #3348)

References

#3228 - llama : custom attention mask + parallel decoding + no context swaps

Author

ggerganov

ggerganov

Committer

ggerganov

ggerganov

Parents

Loading