transformers
[CB] Soft-reset offloading
#43150
Merged

[CB] Soft-reset offloading #43150

ArthurZucker merged 20 commits into main from cb-cpu-offload
remi-or
remi-or remi-or assigned remi-or remi-or 54 days ago
HuggingFaceDocBuilderDev
remi-or Fixed a bug where CB would stop when cache would stop too early
fce246e7
remi-or Added soft-reseting for requests
b1dda636
remi-or QOL for debugging
d949fc4e
remi-or Allow for multiple soft resets
cd5e8b1b
remi-or Style
5d1ff0b8
remi-or Better benchmarks
89dd3029
remi-or Avoid access to non-existent element
9909b53f
remi-or Check ahead of allocation
e0be46fc
remi-or Fix a scheduling bug
877d86fd
remi-or Style
5a459f8d
remi-or Test for will_allocation_be_succesfull
f8e743c5
remi-or Misc.
fbd3411c
remi-or So many bug fixes
4d162fae
remi-or Added test for offloading process
45d0ec91
remi-or Style
24b8d7ec
remi-or remi-or marked this pull request as ready for review 53 days ago
remi-or Documentaion
4ce50c9e
remi-or remi-or force pushed from 9e4f970a to 4ce50c9e 53 days ago
remi-or remi-or requested a review from ArthurZucker ArthurZucker 53 days ago
ArthurZucker
ArthurZucker approved these changes on 2026-01-13
remi-or Merge branch 'main' into cb-cpu-offload
de647693
remi-or
remi-or Review compliance
482f2bfc
remi-or Note
2d0276cc
remi-or Fixed a new bug
1e48c703
github-actions
ArthurZucker ArthurZucker merged b6a473d0 into main 48 days ago
ArthurZucker ArthurZucker deleted the cb-cpu-offload branch 48 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone