DeepSpeed
Update flops profiler to handle attn and matmul
#4724

Merged

Update flops profiler to handle attn and matmul #4724

loadams merged 10 commits into deepspeedai:master from KimmiShi:flops_profiler_attn

KimmiShi changed the title ~~Update flops profiler to handle attn and __matmul__ #4723~~ Update flops profiler to handle attn and __matmul__ 2 years ago

KimmiShi requested a review from

ShijieZZZZ 2 years ago

mrwyattii assigned

mrwyattii 2 years ago

Update flops profiler to handle attn and __matmul__

1576a432

KimmiShi force pushed from 87e0995d to 1576a432 2 years ago

style: update profile.py

eee9064c