[vLLM] Add Qwen-Omni Thinker base models and Gemma 3n per-layer inputs (#49437)
* init: Add all files
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
* refactor: Compose the thinker base models instead of inheriting them
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
* fix: Restore thinker encoder delegation, PEFT alias and CG docstrings
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
* refactor: Align the thinker base models with Qwen2-VL
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
* refactor: Drop the no-mask get_rope_index branches and reword the skip reason
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
* test: Override test_inputs_embeds_matches_input_ids for the Omni thinkers
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
---------
Signed-off-by: Harshal Janjani <harshaljanjani@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Raushan Turganbay <raushan@huggingface.co>