transformers
b6a473d0 - [CB] Soft-reset offloading (#43150)

Commit
7 days ago
[CB] Soft-reset offloading (#43150) * Fixed a bug where CB would stop when cache would stop too early * Added soft-reseting for requests * QOL for debugging * Allow for multiple soft resets * Style * Better benchmarks * Avoid access to non-existent element * Check ahead of allocation * Fix a scheduling bug * Style * Test for will_allocation_be_succesfull * Misc. * So many bug fixes * Added test for offloading process * Style * Documentaion * Review compliance * Note * Fixed a new bug
Author
Parents
Loading