vllm
[Model] Support for fairseq2 Llama
#11442
Merged

[Model] Support for fairseq2 Llama #11442

MartinGleize
github-actions
MartinGleize MartinGleize changed the title [Model] Add support for fairseq2 Llama [Model] Support for fairseq2 Llama 1 year ago
MartinGleize MartinGleize force pushed 1 year ago
MartinGleize MartinGleize marked this pull request as ready for review 1 year ago
robertgshaw2-redhat
MartinGleize
ywang96
ywang96 commented on 2024-12-31
MartinGleize MartinGleize marked this pull request as draft 1 year ago
MartinGleize MartinGleize force pushed 1 year ago
MartinGleize MartinGleize force pushed 1 year ago
MartinGleize MartinGleize marked this pull request as ready for review 1 year ago
MartinGleize MartinGleize marked this pull request as draft 1 year ago
MartinGleize MartinGleize marked this pull request as ready for review 1 year ago
MartinGleize
ywang96
MartinGleize MartinGleize requested a review from mgoin mgoin 1 year ago
MartinGleize MartinGleize requested a review from youkaichao youkaichao 1 year ago
MartinGleize Add support for Fairseq2's Llama
522b5fc2
MartinGleize Remove unnecessary method override
27dda0bb
Add support for tp-sharded checkpoints
2c914069
MartinGleize Shorter implementation
d059e38a
MartinGleize Flag params with sharded weights to prevent narrowing in Llama loading
24411159
MartinGleize Add weight loading test for fairseq2
1e8d7d33
MartinGleize MartinGleize force pushed to 1e8d7d33 1 year ago
MartinGleize
MartinGleize
MartinGleize MartinGleize requested a review from ywang96 ywang96 1 year ago
ywang96
ywang96 approved these changes on 2025-01-19
ywang96 ywang96 added ready
MartinGleize Improve check on sharded embedding shape
fd42679d
MartinGleize Add model to test registry, one test was failing because of it
0c40d962
MartinGleize MartinGleize requested a review from DarkLight1337 DarkLight1337 1 year ago
MartinGleize
ywang96 ywang96 merged bbe5f9de into main 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone