transformers
8aed0197 - [generate] `torch.distributed`-compatible `DynamicCache` (#36373)

Commit
363 days ago
[generate] `torch.distributed`-compatible `DynamicCache` (#36373) * test * docstring * prepare distributed cache data * fix cat dim * test mvp * add test checks * like this? * working test and solution * nit * nit * add shape info
Author
Parents
Loading