DeepSpeed
Avoid graph breaks in torch.compile caused by inner classes in the backward hooks
#7062
Merged
Merged
Avoid graph breaks in torch.compile caused by inner classes in the backward hooks #7062
loadams
merged
22 commits into
deepspeedai:master
from
deepcharm:avoid-graph-break-caused-by-inner-classes
tjruwase
approved these changes
on 2025-02-23
disabled auto-merge 1 year ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
Avoid graph breaks caused by inner classes in the backward hooks
07bd88e5
Rename aio_thread_count to intra_op_parallelism (#7056)
3205186a
add autoTP training zero2 tests (#7049)
52fbbc11
Fix, bf16 optimizer remove dup loop (#7054)
8b5d8647
Update version.txt after 0.16.4 release (#7063)
e7e9d3e4
fix an outdated doc wrt CUDA_VISIBLE_DEVICES (#7058)
2c950eef
Tecorigin sdaa accelerator (#6903)
a4853fc6
Handle special case of libuv for Windows (#7064)
7d6fc03b
Update README with info on newest accelerator (#7065)
d39269d2
Bug Fix for offload_states API (#7050)
3cd7a5c2
Fix TOCTOU issues, switch to fstat (#7067)
3767709a
config torch to avoid graph breaks caused by logger (#6999)
495606a5
Fix meta load tensor imcompatible issue (#7073)
20e85099
Replace calls to `python setup.py sdist` with `python -m build --sdis…
ad7b43b5
Revert "Handle special case of libuv for Windows (#7064)" (#7076)
672b918f
Handle special case of libuv for Windows (#7064)
929a09c9
Revert "Handle special case of libuv for Windows (#7064)" (#7076)
623f7cfa
Add DeepseekV3 AutoTP. (#7045)
fd94138d
Improve inference tutorial docs (#7083)
7357edc7
Merge branch 'master' into avoid-graph-break-caused-by-inner-classes
e7b622bc
Merge branch 'master' into avoid-graph-break-caused-by-inner-classes
62843748
Merge branch 'master' into avoid-graph-break-caused-by-inner-classes
a5bfd575
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub