Value
#13468

Merged

[Bugfix] Initialize attention bias on the same device as Query/Key/Value #13468

simon-mo merged 1 commit into vllm-project:main from edwardzjl:attn_bias_device

edwardzjl force pushed 348 days ago

[Bugfix] Initialize attention bias on the same device as Query/Key/Value

275d0829

edwardzjl force pushed to 275d0829 342 days ago

Isotr0py approved these changes on 2025-02-24

Isotr0py enabled auto-merge (squash) 342 days ago

github-actions added ready

simon-mo merged 75e9d497 into main 341 days ago

Reviewers

Isotr0py

Assignees

No one assigned

Labels

ready

Milestone

No milestone