xla
046f9103
- [Backport] Allow setting FlashAttention's causal mask (#6837)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
[Backport] Allow setting FlashAttention's causal mask (#6837) Summary: This pull request channels the causal mask to our wrapper. Test Plan: PJRT_DEVICE=TPU python test/test_pallas.py -v -k test_flash_attention_wrapper_causal
References
#6837 - [Backport] Allow setting FlashAttention's causal mask
Author
alanwaketan
Parents
8de8cea3
Loading