transformers
51296712 - Add a static cache that offloads to the CPU or other device (#32161)

Commit

1 year ago

Add a static cache that offloads to the CPU or other device (#32161) * Add a static cache that offloads to the CPU or other device * Fix PR comments, add unit-tests

References

#32161 - Add a static cache that offloads to the CPU or other device

Author

gerbenvv

Parents

92a75ff6

transformers 51296712 - Add a static cache that offloads to the CPU or other device (#32161)

transformers
51296712 - Add a static cache that offloads to the CPU or other device (#32161)