llama.cpp
7c1bdd0e - llama : apply K-cache roping for Falcon and Baichuan

Commit

2 years ago

llama : apply K-cache roping for Falcon and Baichuan

References

#3228 - llama : custom attention mask + parallel decoding + no context swaps

Author

ggerganov

ggerganov

Parents

Loading