transformers
db05e4ff - [pagged-attention] fix off-by-1 error in pagged attention generation (#39258)

Commit

163 days ago

[pagged-attention] fix off-by-1 error in pagged attention generation (#39258) * fix off-by-1 error in pagged attention generation * formatting * use update_with_token

References

#39258 - [pagged-attention] fix off-by-1 error in pagged attention generation

Author

kashif

Parents

6f1a4389

transformers db05e4ff - [pagged-attention] fix off-by-1 error in pagged attention generation (#39258)

transformers
db05e4ff - [pagged-attention] fix off-by-1 error in pagged attention generation (#39258)