transformers
f93b239e - reconstruct cache_position from _length: 0003

Commit

2 years ago

reconstruct cache_position from _length: 0003

References

dynamic_length_in_static_cache_reconstruct_tensors_from_length

#30862 - [WIP] Dynamic length in static cache

Author

ydshieh

ydshieh

Parents

Loading