vllm
[Llama4] Enable attention temperature tuning by default for long context (>32k)
#16439
Merged
Merged
[Llama4] Enable attention temperature tuning by default for long context (>32k) #16439
vllm-bot
merged
2 commits into
vllm-project:main
from
yeqcharlotte:default_attn_temp_tuning
turn on attn temp tuning by default
7fe8f463
default attn temp tuning for >32k only
7575935b
yeqcharlotte
approved these changes
on 2025-04-11
houseroad
approved these changes
on 2025-04-11
mgoin
approved these changes
on 2025-04-11
Reviewers
Assignees
No one assigned
Labels
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub