vllm
[Model] Support for fairseq2 Llama
#11442
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
8
Changes
View On
GitHub
[Model] Support for fairseq2 Llama
#11442
ywang96
merged 8 commits into
vllm-project:main
from
MartinGleize:fairseq2_llama
MartinGleize
changed the title
[Model] Add support for fairseq2 Llama
[Model] Support for fairseq2 Llama
1 year ago
MartinGleize
force pushed
1 year ago
MartinGleize
marked this pull request as ready for review
1 year ago
ywang96
commented on 2024-12-31
MartinGleize
marked this pull request as draft
1 year ago
MartinGleize
force pushed
1 year ago
MartinGleize
force pushed
1 year ago
MartinGleize
marked this pull request as ready for review
1 year ago
MartinGleize
marked this pull request as draft
1 year ago
MartinGleize
marked this pull request as ready for review
1 year ago
MartinGleize
requested a review
from
mgoin
1 year ago
MartinGleize
requested a review
from
youkaichao
1 year ago
Add support for Fairseq2's Llama
522b5fc2
Remove unnecessary method override
27dda0bb
Add support for tp-sharded checkpoints
2c914069
Shorter implementation
d059e38a
Flag params with sharded weights to prevent narrowing in Llama loading
24411159
Add weight loading test for fairseq2
1e8d7d33
MartinGleize
force pushed
to
1e8d7d33
1 year ago
MartinGleize
requested a review
from
ywang96
1 year ago
ywang96
approved these changes on 2025-01-19
ywang96
added
ready
Improve check on sharded embedding shape
fd42679d
Add model to test registry, one test was failing because of it
0c40d962
MartinGleize
requested a review
from
DarkLight1337
1 year ago
ywang96
merged
bbe5f9de
into main
1 year ago
Login to write a write a comment.
Login via GitHub
Reviewers
ywang96
mgoin
youkaichao
DarkLight1337
Assignees
No one assigned
Labels
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub