DeepSpeed
1ec42552 - triton supports the flash attention when compute cap > 8.0

Commit

2 years ago

triton supports the flash attention when compute cap > 8.0

References

#4337 - adds triton flash attention2 kernel

Author

styoun

styoun

Parents

Loading