onnxruntime
Create a CUDA based memory arena instead of Cuda Allocator wrapped into BFCArena
#26535
Merged
Overview
Commits
23
Changes
View On GitHub

Create a CUDA based memory arena instead of Cuda Allocator wrapped into BFCArena #26535

yuslepukhin merged 23 commits into main from yuslepukhin/cuda_pool_arena
yuslepukhin
yuslepukhin Prepare for new arena allocator
cc10979b
yuslepukhin Merge branch 'main' into yuslepukhin/cuda_pool_arena
8074a9c5
yuslepukhin Implement cuda mempool arena
a92a19b7
yuslepukhin Add tests
a4c001f9
yuslepukhin Test run
791539dc
yuslepukhin Merge branch 'main' into yuslepukhin/cuda_pool_arena
433d5119
yuslepukhin Add shrink arena option
84a81a2b
yuslepukhin Fix bugs in -A and -M handling, add shrink argument
1d2c9f78
yuslepukhin Add more logging, enable perf_tool
8ffa76ae
yuslepukhin yuslepukhin requested a review from skottmckay skottmckay 51 days ago
yuslepukhin yuslepukhin requested a review from adrianlizarraga adrianlizarraga 51 days ago
yuslepukhin yuslepukhin requested a review from tianleiwu tianleiwu 51 days ago
yuslepukhin yuslepukhin requested a review from chilo-ms chilo-ms 51 days ago
yuslepukhin yuslepukhin requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 51 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2025-11-07
yuslepukhin Address comments
37e9f5b7
yuslepukhin Address signed issue
c8bb6397
yuslepukhin Fix loraadapters and tests
e6e167e4
adrianlizarraga
adrianlizarraga commented on 2025-11-12
yuslepukhin Remove ReleaseStreamBuffers() override
f12b0598
yuslepukhin yuslepukhin changed the title [DRAFT] Create a CUDA based memory arena instead of Cuda Allocator wrapped into BFCArena Create a CUDA based memory arena instead of Cuda Allocator wrapped into BFCArena 46 days ago
yuslepukhin yuslepukhin marked this pull request as ready for review 46 days ago
gedoensmax
gedoensmax commented on 2025-11-13
yuslepukhin Address comments and failures
f4ecd097
hariharans29
hariharans29 commented on 2025-11-13
yuslepukhin Add include
d5db49f1
hariharans29
hariharans29 commented on 2025-11-13
yuslepukhin Merge branch 'main' into yuslepukhin/cuda_pool_arena
3e1a5383
yuslepukhin Remove dangling comment
27b76265
hariharans29
hariharans29 commented on 2025-11-14
hariharans29
hariharans29 commented on 2025-11-14
hariharans29
hariharans29 commented on 2025-11-14
hariharans29
hariharans29 commented on 2025-11-14
hariharans29
hariharans29 commented on 2025-11-14
hariharans29
hariharans29 commented on 2025-11-14
hariharans29
hariharans29 commented on 2025-11-14
hariharans29
hariharans29 commented on 2025-11-14
yuslepukhin Address code review comments
ab442e1e
yuslepukhin Update onnxruntime/test/lora/lora_test.cc
5580d431
yuslepukhin Merge branch 'main' into yuslepukhin/cuda_pool_arena
4c5ea760
hariharans29
hariharans29 commented on 2025-11-14
hariharans29
hariharans29
hariharans29 dismissed these changes on 2025-11-14
yuslepukhin
tianleiwu
tianleiwu dismissed these changes on 2025-11-14
yuslepukhin Return test check
2daf64e4
yuslepukhin yuslepukhin dismissed their stale review via 2daf64e4 44 days ago
yuslepukhin yuslepukhin dismissed their stale review via 2daf64e4 44 days ago
tianleiwu
tianleiwu dismissed these changes on 2025-11-15
hariharans29
hariharans29 dismissed these changes on 2025-11-15
hariharans29
yuslepukhin Disable Cuda Mempool arena when graph capture is enabled.
810ace5c
yuslepukhin Merge branch 'main' into yuslepukhin/cuda_pool_arena
6c0fba17
yuslepukhin yuslepukhin dismissed their stale review via 6c0fba17 41 days ago
yuslepukhin yuslepukhin dismissed their stale review via 6c0fba17 41 days ago
hariharans29
hariharans29 approved these changes on 2025-11-17
yuslepukhin yuslepukhin enabled auto-merge (squash) 41 days ago
disabled auto-merge 40 days ago
Manually disabled by user
yuslepukhin yuslepukhin closed this 40 days ago
yuslepukhin yuslepukhin reopened this 40 days ago
yuslepukhin yuslepukhin merged e6023b0c into main 39 days ago
yuslepukhin yuslepukhin deleted the yuslepukhin/cuda_pool_arena branch 39 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum