llama.cpp
tests: enable kv_unified for test-backend-sampler
#20645
Merged

tests: enable kv_unified for test-backend-sampler #20645

taronaeo
taronaeo taronaeo requested a review from ggerganov ggerganov 25 days ago
taronaeo taronaeo requested a review from danbev danbev 25 days ago
danbev
danbev approved these changes on 2026-03-16
danbev
ggerganov
ggerganov
github-actions github-actions added testing
taronaeo
taronaeo tests: enable kv_unified to prevent cuda oom error on rtx 2060
86a7113b
taronaeo taronaeo force pushed from 9d385f30 to 86a7113b 24 days ago
taronaeo taronaeo changed the title tests: set dist_sampling seq_id to 0 tests: enable kv_unified for test-backend-sampler 24 days ago
taronaeo
taronaeo taronaeo merged fe00a84b into master 24 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone