vllm
[Bugfix] Fix Voxtral streaming slot_mapping
#33073

Merged

Commits

get_impl_class to compute slot mapping

NickLucche committed 188 days ago
cruft

NickLucche committed 188 days ago
Merge branch 'main' into fix-voxtral-kv-update

NickLucche committed 188 days ago

Loading