DeepSpeed
Avoid graph breaks in torch.compile caused by inner classes in the backward hooks
#7062
Merged

Commits
  • Avoid graph breaks caused by inner classes in the backward hooks
    deepcharm committed 1 year ago
  • Rename aio_thread_count to intra_op_parallelism (#7056)
    deepcharm committed 1 year ago
  • add autoTP training zero2 tests (#7049)
    deepcharm committed 1 year ago
  • Fix, bf16 optimizer remove dup loop (#7054)
    deepcharm committed 1 year ago
  • Update version.txt after 0.16.4 release (#7063)
    deepcharm committed 1 year ago
  • fix an outdated doc wrt CUDA_VISIBLE_DEVICES (#7058)
    deepcharm committed 1 year ago
  • Tecorigin sdaa accelerator (#6903)
    deepcharm committed 1 year ago
  • Handle special case of libuv for Windows (#7064)
    deepcharm committed 1 year ago
  • Update README with info on newest accelerator (#7065)
    deepcharm committed 1 year ago
  • Bug Fix for offload_states API (#7050)
    deepcharm committed 1 year ago
  • Fix TOCTOU issues, switch to fstat (#7067)
    deepcharm committed 1 year ago
  • config torch to avoid graph breaks caused by logger (#6999)
    deepcharm committed 1 year ago
  • Fix meta load tensor imcompatible issue (#7073)
    deepcharm committed 1 year ago
  • Replace calls to `python setup.py sdist` with `python -m build --sdist` (#7069)
    deepcharm committed 1 year ago
  • Revert "Handle special case of libuv for Windows (#7064)" (#7076)
    deepcharm committed 1 year ago
  • Handle special case of libuv for Windows (#7064)
    deepcharm committed 1 year ago
  • Revert "Handle special case of libuv for Windows (#7064)" (#7076)
    deepcharm committed 1 year ago
  • Add DeepseekV3 AutoTP. (#7045)
    deepcharm committed 1 year ago
  • Improve inference tutorial docs (#7083)
    deepcharm committed 1 year ago
  • Merge branch 'master' into avoid-graph-break-caused-by-inner-classes
    tjruwase committed 1 year ago
  • Merge branch 'master' into avoid-graph-break-caused-by-inner-classes
    loadams committed 1 year ago
  • Merge branch 'master' into avoid-graph-break-caused-by-inner-classes
    loadams committed 1 year ago
Loading