DeepSpeed
d33b5623
- [Ulysses-ALST] add FA3 support (#7430)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
146 days ago
[Ulysses-ALST] add FA3 support (#7430) FA3 is needed for 500K+ seqlen on llama-8b. Signed-off-by: Stas Bekman <stas.bekman@snowflake.com> Co-authored-by: Stas Bekman <stas.bekman@snowflake.com>
References
#7430 - [Ulysses-ALST] add FA3 support
Author
stas00
Parents
ee286e53
Loading