jax
1043e24f - Add quantization support for PagedAttention TPU Pallas kernel.

Commit

1 year ago

Add quantization support for PagedAttention TPU Pallas kernel. PiperOrigin-RevId: 634914369

References

Author

ashishenoyp

Committer

a-googler

Parents