transformers
65d834fb - Move `value` padding into the attention interfaces that need it (#47451)

Commit
123 days ago
Move `value` padding into the attention interfaces that need it (#47451) * Use metadata instead of string matching to pad `value_states` in MLA models Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> * make style Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> * Move padding inside attention interfaces that need it Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> --------- Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Author
Parents
Loading