DeepSpeed
Auto convert moe param groups
#5354
Merged

Auto convert moe param groups #5354

jeffra
jeffra ensure capacity does not exceed number of tokens
d6d1bfe6
jeffra auto convert moe param groups
c96e3500
jeffra remove unrelated test
e942e76b
jeffra jeffra requested a review from mrwyattii mrwyattii 2 years ago
jeffra jeffra requested a review from tjruwase tjruwase 2 years ago
jeffra jeffra requested a review from awan-10 awan-10 2 years ago
jeffra jeffra requested a review from loadams loadams 2 years ago
jeffra Update test_moe.py
2c42ef11
jeffra Merge branch 'master' into auto-param-group
5905f9b7
tohtana
tohtana commented on 2024-04-04
jeffra Merge branch 'master' into auto-param-group
955e37c7
jeffra address comments
9bd9a1f3
jeffra Merge branch 'master' into auto-param-group
0fc1020e
tohtana
tohtana approved these changes on 2024-04-05
sfc-gh-jrasley formatting
54a8a32b
loadams loadams enabled auto-merge 2 years ago
loadams loadams merged 42a8eaa7 into master 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone