Add pipeline parallel plan to `PretrainedConfig` and `PreTrainedModel` #36091
Add `base_model_pp_plan` to `PretrainedConfig`
64f1fd67
Add `_pp_plan` to `PreTrainedModel`
040ba146
Add both to Llama for testing
ac56826c
Fix type error
fee056f4
nmntz
commented
on 2025-02-07
Update to suggested schema
826cd178
`_pp_plan` keys are not patterns
cfee6801
Simplify schema
7e03c0db
Fix typing error
b9ee76ff
Update input name for Llama
f5ed1518
Add pp plan to Aria
cb60de85
Add pp plan to Bamba
9a079032
Add pp plan to Cohere 1 & 2
57a2aa57
Add pp plan to diffllama and emu3
2703a9e8
Add pp plan to Gemma 1 & 2
19f53461
Add pp plan to GLM and GPT NeoX
5de4151d
Add pp plan to Granite and Helium
3a490d86
Add pp plan to Mistral and Mixtral
0c2c8df9
Add pp plan to OLMo 1 & 2
c8960621
Add pp plan to Phi and Phi 3
c01266db
Add pp plan for Qwen 2, 2 MoE, 2 VL and 2.5 VL
81c11859
Add pp plan for Starcoder 2
95cec4b2
Add enum for accessing inputs and outputs
387e3a85
Merge branch 'main' into add-pp-plan
dd1a2d51
hmellor
marked this pull request as ready for review 1 year ago
nmntz
approved these changes
on 2025-02-10
Update type hints to use tuples
dca584d0
Change outer list to tuple
02129121
hmellor
deleted the add-pp-plan branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub