llm-foundry
85403c08
- Bumping flash attention version to 2.6.3 and adding option for softcap in attention and lm_head logits. (#1374)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Bumping flash attention version to 2.6.3 and adding option for softcap in attention and lm_head logits. (#1374)
References
#1374 - Bumping flash attention version to 2.6.3 and adding option for softcap in attention and lm_head logits.
Author
ShashankMosaicML
Parents
a2c05077
Loading