DeepSpeed
Enable hpz based on secondary tensor presence
#4906
Merged

Enable hpz based on secondary tensor presence #4906

mrwyattii merged 28 commits into master from HeyangQin/mixz_hpz_fix
HeyangQin
HeyangQin Fix potential secondary tensor out of sync issue
48ddf31d
HeyangQin remove all forward/backward flag and use existence of secondary tenso…
1bc053f0
tjruwase tjruwase requested a review from samadejacobs samadejacobs 1 year ago
HeyangQin fix conflict with master
03e85c58
HeyangQin fix format
b99d25a4
HeyangQin enable hpz for lora frozen weights
165a854c
HeyangQin HeyangQin marked this pull request as ready for review 1 year ago
HeyangQin HeyangQin requested a review from tjruwase tjruwase 1 year ago
HeyangQin HeyangQin requested a review from mrwyattii mrwyattii 1 year ago
HeyangQin Merge branch 'master' into HeyangQin/mixz_hpz_fix
aad9403f
samadejacobs
samadejacobs approved these changes on 2024-01-08
tjruwase
tjruwase commented on 2024-01-08
HeyangQin change param partitioning logic
a516257c
HeyangQin Merge branch 'HeyangQin/mixz_hpz_fix' of https://github.com/microsoft…
f86e8803
HeyangQin bring back profiler
71bbf1cd
HeyangQin Merge branch 'master' into HeyangQin/mixz_hpz_fix
9f251582
HeyangQin bring back forward flag for profiling
7d20df7c
HeyangQin update unit test
6bbb2ae9
HeyangQin HeyangQin requested a review from loadams loadams 1 year ago
HeyangQin add convergence test
ae508558
HeyangQin tmp change to workflow for test
ecfd60f8
HeyangQin relax time out for convergence test
63512ef4
HeyangQin revert tmp changes
786eed07
HeyangQin add nightly flag
67d5e2ea
HeyangQin Merge branch 'master' into HeyangQin/mixz_hpz_fix
86a72a5f
HeyangQin Fix whitespace in nv-torch-latest-v100.yml
b88f0012
HeyangQin fix format
1485bfa2
HeyangQin HeyangQin requested a review from awan-10 awan-10 1 year ago
HeyangQin HeyangQin requested a review from arashb arashb 1 year ago
HeyangQin fix incorrect format by clang
77d227e6
HeyangQin skip test if datasets is not installed
b4188412
HeyangQin fix format
5e684e64
mrwyattii Update nv-nightly.yml
8857c077
mrwyattii remove test skip
d58631fb
mrwyattii re-add import
345f653e
mrwyattii Merge branch 'master' into HeyangQin/mixz_hpz_fix
d6c4b1a3
mrwyattii
mrwyattii
mrwyattii commented on 2024-01-25
mrwyattii Update tests/unit/runtime/zero/test_zeropp.py
e17de06e
mrwyattii
mrwyattii approved these changes on 2024-01-25
mrwyattii mrwyattii enabled auto-merge 1 year ago
mrwyattii mrwyattii merged 75ed63c9 into master 1 year ago
mrwyattii mrwyattii deleted the HeyangQin/mixz_hpz_fix branch 1 year ago
siddharth9820

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone