llm-foundry
3c278a92 - Add fp32 to the set of valid inputs to attention layer (#1347)

Commit
1 year ago
Add fp32 to the set of valid inputs to attention layer (#1347) Add support for Torch attn + FP32 + FSDP Mixed Precision FULL
Author
Parents
Loading