onnxruntime
fba09faf - Implement reuse past and present tensor in Attention Ops. (#13791)

Commit
3 years ago
Implement reuse past and present tensor in Attention Ops. (#13791) Implement reuse kv_cache past and present tensor in Attention Ops. Unit test for abover feature. Utilize the reuse kv_cache for past and present tensor in Greedy Search. Correctness test for it. Co-authored-by: Zhang Lei <phill.zhang@gmail.com>
Author
Parents
Loading