adding 3 q,k,v buffers in all cases - SemanticDiff

Commit

5 years ago

adding 3 q,k,v buffers in all cases

References

#8039 - Attention kernel update to handle different Q,K,V hidden sizes

Author

viboga

viboga

Parents

Loading