benchmark
fdb33106 - adding llama inference specific shapes for flash attention

Commit
1 year ago
adding llama inference specific shapes for flash attention Summary: flash attention benchmarks are great but did not have the llama inference specific shapes. adding a few here Reviewed By: xuzhao9 Differential Revision: D62139758 fbshipit-source-id: a1df168bced7bebedbe4badec9dec57cc709da2c
Author
Parents
Loading