vllm
[Transformers backend] Support LoRA on lm_head and on any input embedding name
#66413
Merged

[Transformers backend] Support LoRA on lm_head and on any input embedding name #66413

hmellor
hmellor [Transformers backend] Support LoRA on lm_head and aux hidden state l…
5fc13914
mergify mergify added llama
mergify mergify added speculative-decoding
mergify mergify added mrv2
mergify mergify added kv-connector
hmellor Move aux hidden state layer 0 support to #66546
a8c05056
hmellor hmellor changed the title [Transformers backend] Support LoRA on lm_head and aux hidden state layer 0 [Transformers backend] Support LoRA on lm_head 13 days ago
hmellor Derive the input embedding name for LoRA from the Transformers model
8b6486c5
hmellor Compare the embed_in LoRA test against HF in fp16
9597f6be
hmellor hmellor changed the title [Transformers backend] Support LoRA on lm_head [Transformers backend] Support LoRA on lm_head and on any input embedding name 13 days ago
hmellor Allow embedding_modules to be set per instance
a36e6c6f
hmellor Rename input_embedding_modules to embedding_modules
bb3c58fe
hmellor Trim the embed_in LoRA test
8bda795a
hmellor hmellor marked this pull request as ready for review 13 days ago
hmellor hmellor requested a review from jeejeelee jeejeelee 13 days ago
claude
claude commented on 2026-11-09
Isotr0py
Isotr0py approved these changes on 2026-11-09
hmellor hmellor enabled auto-merge (squash) 13 days ago
hmellor
github-actions github-actions added ready
vllm-agent Merge branch 'main' into transformers-backend-llama-parity
4108d096
github-actions
hmellor
github-actions
hmellor Spawn a fresh process for the embed_in LoRA test
1bbce788
hmellor Merge remote-tracking branch 'origin/transformers-backend-llama-parit…
47521207
hmellor Load the embed_in LoRA test model on the current platform's device
573a8da0
hmellor Fix line length in the embed_in LoRA test
82a9ac28
hmellor
github-actions
disabled auto-merge 13 days ago
Manually disabled by user
hmellor hmellor merged 7841981e into main 13 days ago
hmellor hmellor deleted the transformers-backend-llama-parity branch 13 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone