transformers
0395ed52 - [`CB`] Refactors the way we access paged (#41370)

Commit

128 days ago

[`CB`] Refactors the way we access paged (#41370) * up * refactor the way we handle paged attention * affect serve as well * update * fix * cup

References

Author

ArthurZucker

Parents