vllm
[Bugfix][Model] Fix Qwen3.5/Qwen3Next ignoring --dtype flag on older GPUs
#35617
Merged

[Bugfix][Model] Fix Qwen3.5/Qwen3Next ignoring --dtype flag on older GPUs #35617

lailoo
lailoo fix(model): use default dtype instead of HF config.dtype in Qwen3.5/Q…
c7252f15
lailoo lailoo requested a review from sighingnow sighingnow 70 days ago
mergify mergify added qwen
mergify mergify added bug
gemini-code-assist
gemini-code-assist commented on 2026-02-28
Isotr0py
Isotr0py approved these changes on 2026-02-28
Isotr0py Isotr0py enabled auto-merge (squash) 70 days ago
github-actions github-actions added ready
lailoo Merge branch 'main' into fix/qwen3-respect-user-dtype-35414
db6f62c8
lailoo Merge branch 'main' into fix/qwen3-respect-user-dtype-35414
f1d35492
Isotr0py Isotr0py merged afd089f2 into main 70 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone