transformers
[vLLM] Add Omni token counting and text replacement offsets for the Transformers backend
#49435
Merged
Merged
[vLLM] Add Omni token counting and text replacement offsets for the Transformers backend #49435
zucchini-nlp
merged
17 commits into
huggingface:main
from
harshaljanjani:feat/omni-processors-and-thinker-vllm
init: Add all files
0739aaa2
harshaljanjani
changed the title
refactor: Split out the modeling-file changes
00184b4b
fix: Count Qwen2.5-Omni audio tokens from padded feature frames
08e127c4
refactor: Build Gemma3n processor inputs through the ProcessorMixin h…
33a8b3ee
refactor: Move the Gemma3n text type check into validate_inputs
40aa137c
Merge remote-tracking branch 'hf/main' into feat/omni-processors-and-…
11054dc4
refactor: Move the Qwen-Omni processors onto the OmniModalProcessorMi…
4396a648
fix: Process audio as usual when load_audio_from_video gets no videos
e2eade00
refactor: Address the round 3 review on the Qwen-Omni processors
abb9625b
refactor: Address the round 4 review on the Qwen-Omni processors
5170fe7b
zucchini-nlp
commented
on 2026-11-03
refactor: Address the round 5 review on the Omni processors
4fc53976
test: Move the audio token count test into the Mixin
4f53aed2
zucchini-nlp
commented
on 2026-11-04
zucchini-nlp
commented
on 2026-11-04
zucchini-nlp
commented
on 2026-11-04
zucchini-nlp
commented
on 2026-11-04
refactor: Address the round 7 review on the Omni processors
ce7c4e61
test: Seed the Cohere ASR double-shift test before the model init
0fd30be5
disabled auto-merge 2 days ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
Merge remote-tracking branch 'hf/main' into feat/omni-processors-and-…
e890383c
fix: Count only standalone audio against the placeholders in the Omni…
4274e31a
disabled auto-merge 2 days ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
fix: Return a list of prompts from the Gemma3n inputs layout for audi…
5fa7d3d1
zucchini-nlp
approved these changes
on 2026-11-06
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub