AndreasKaratzas
changed the title [Engine] Fix engine stalling when async KV offload defers block frees [Engine] Fix GPU memory leaks in engine shutdown and add synchronous flush for prefix cache reset.230 days ago
AndreasKaratzas
changed the title [Engine] Fix GPU memory leaks in engine shutdown and add synchronous flush for prefix cache reset. [Engine] Fix GPU memory leaks in engine shutdown and add synchronous flush for prefix cache reset230 days ago
[ROCm][RIXL] Updated version with mem leak fix
c2a6d267
[CI] Fix OOM in torchrun MoE test by limiting max_model_len to 2048
c965356d
[ROCm][RIXL] Updated version with mem leak fix
82101170
[ROCm][RIXL] Updated version with mem leak fix
853a0198
[ROCm][RIXL] Updated version with mem leak fix
c2eae4fd
[ROCm][RIXL] Updated version with mem leak fix
e590ab2c
[ROCm][RIXL] Updated version with mem leak fix
1fabac86
[ROCm][RIXL] Updated version with mem leak fix
ec839ff4
[ROCm][RIXL] Updated version with mem leak fix
a9e0dc9d
AndreasKaratzas
changed the title [Engine] Fix GPU memory leaks in engine shutdown and add synchronous flush for prefix cache reset [ROCm][Engine] Fix GPU memory leaks in engine shutdown and add synchronous flush for prefix cache reset230 days ago
[ROCm][RIXL] Updated version with mem leak fix
7a2a3c65
AndreasKaratzas
changed the title [ROCm][Engine] Fix GPU memory leaks in engine shutdown and add synchronous flush for prefix cache reset [ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset230 days ago
[ROCm][CI] Bump RIXL/UCX hashes and resolve mem leak IPC issue
584c8efa
Merge remote-tracking branch 'origin/main' into akaratza_fix_engine_a…
7d6517c8
[ROCm] Parametrize ROCm path
029b092a
[ROCm] Remove wrong rixl build param
030a7957
Merge remote-tracking branch 'origin/main' into akaratza_fix_engine_a…
Login to write a write a comment.
Login via GitHub