DeepSpeed
98c96e79 - Update flops profiler to handle attn and __matmul__ (#4724)

Commit
1 year ago
Update flops profiler to handle attn and __matmul__ (#4724) Fixes #4723 - handle `F.scaled_dot_product_attention` in transformer models. - handle expreesions like `a@b` --------- Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>
Author
Parents
Loading