vllm
[Bugfix] Initialize attention bias on the same device as Query/Key/Value
#13468
Merged

[Bugfix] Initialize attention bias on the same device as Query/Key/Value #13468

edwardzjl
github-actions
edwardzjl edwardzjl force pushed 348 days ago
edwardzjl edwardzjl force pushed 348 days ago
edwardzjl edwardzjl force pushed 348 days ago
edwardzjl
edwardzjl
edwardzjl [Bugfix] Initialize attention bias on the same device as Query/Key/Value
275d0829
edwardzjl edwardzjl force pushed to 275d0829 342 days ago
Isotr0py
Isotr0py approved these changes on 2025-02-24
Isotr0py Isotr0py enabled auto-merge (squash) 342 days ago
github-actions github-actions added ready
simon-mo simon-mo merged 75e9d497 into main 341 days ago
dipta007
Roxanne527
edwardzjl

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone