transformers
0979a869 - Fix OOM in Mamba2IntegrationTest by using MemoryCleanupMixin (#50808)

Commit
2 days ago
Fix OOM in Mamba2IntegrationTest by using MemoryCleanupMixin (#50808) Use MemoryCleanupMixin in Mamba2IntegrationTest to fix CI OOM Three tests each load mistralai/Mamba-Codestral-7B-v0.1 (bf16, ~13.4 GB) and nothing frees it after the test, so the next test loads a second copy and runs out of memory on a 22 GB GPU. Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Author
Parents
Loading