transformers
0d04b1e2 - Add Flash Attention 2 support to Musicgen and Musicgen Melody (#29939)

Commit
1 year ago
Add Flash Attention 2 support to Musicgen and Musicgen Melody (#29939) * add FA2 to o.g Musicgen * make style * add FA2 support to Musicgen Melody * add generation FA2 tests to o.g Musicgen * make style and fix copies * add Musicgen to FA2 docs + deprecate list * add sdpa supports to Musicgen's * make style and fix copies * refactor attention implementation arguments * add Copied from to sdpa tests * add copied form in sdpa tests melody * add copied for FA2 generation tests * add FA2 inference copied from * make style
Author
Parents
Loading