microsoft/DeepSpeed

Pull Requests Commits

Further refactor deepspeed.moe.utils + deepspeed.moe.layer type hints (#5060)

Matthew Hoffman committed 1 year ago

Verified 9922270f

[doc/1-line change] default stage3_param_persistence_threshold is wrong in the doc (#5073)

ByronHsu committed 1 year ago

Verified 3e6d6069

Make batch size documentation clearer (#5072)

segyges committed 1 year ago

Verified dde64b00

[Zero++ qgZ] Fall back to reduce_scatter if `tensor.numel() % (2 * global_world_size) != 0` (#5056)

ByronHsu committed 1 year ago

Verified 592325ab

adding hccl to init_distributed function description (#5034)

nelyahu committed 1 year ago

Verified 2eafe41b

Update import for changes to latest diffusers (#5065)

mrwyattii committed 1 year ago

Verified a049370c

load linear layer weight with given dtype (#4044)

polisettyvarma committed 1 year ago

Verified 567f97b2

Optimize grad_norm calculations by reducing device/host dependency (#4974)

nelyahu committed 1 year ago

Verified 61daaa1e

Delay reduce-scatter for ZeRO3 leaf modules (#5008)

tohtana committed 1 year ago

Verified 19e0dc39

[NPU] Change log level to debug (#5051)

CurryRice233 committed 1 year ago

Verified 6de31de7

Fix broken model names in inference CI (#5053)

mrwyattii committed 1 year ago

Verified 449f9ad0

[doc] update inference related docs from `mp_size` to `tensor_parallel` for TP (#5048)

yundai424 committed 1 year ago

Verified 76ec8b49

MoE type hints (#5043)

Matthew Hoffman committed 1 year ago

Verified 971d82b5

[NPU] Add NPU to support hybrid engine (#4831)

CurryRice233 committed 1 year ago

Verified 88cca60a

Fix nv-torch-latest-cpu CI (#5045)

mrwyattii committed 1 year ago

Verified 93e9537d

launcher_helper: enable fds passing (#5042)

YizhouZ committed 1 year ago

Verified 8f627700

update inference pages to point to FastGen (#5029)

mrwyattii committed 1 year ago

Verified 24f20ef0

Fix nv-accelerate and nv-torch-latest-v100. (#5035)

loadams committed 1 year ago

Verified 546d08ee

Fix for nightly torch CI (#5039)

mrwyattii committed 1 year ago

Verified f0e5bece

Fix P40 CI failures (#5037)

mrwyattii committed 1 year ago

Verified 6857061a

Remove Megatron-DeepSpeed CI workflow (#5038)

mrwyattii committed 1 year ago

Verified db22e7a7

Remove coverage reports from workflows and fix for inference CI (#5028)

loadams committed 1 year ago

Verified f5920457

Remove MI100 badge from landing page (#5036)

mrwyattii committed 1 year ago

Verified 8c30e7c4

Graph capture support on HPU accelerators (#5013)

deepcharm committed 1 year ago

Verified 8ec1cc3b

launcher/launcher_helper.py: fix PMI name and add EnvironmentError (#5025)

YizhouZ committed 1 year ago

Verified 66fb9241

deepspeed/launcher: add launcher_helper as each rank's start portal (#4699)

YizhouZ committed 1 year ago

Verified 6e1a6801

[minor] Improve logging for multiprocesses (#5004)

ByronHsu committed 1 year ago

Verified 9500ab7d

DS #4993 #662 : autotune single node hostfile bugfix (#4996)

oushu1zhangxiangxuan1 committed 1 year ago

Verified c0525451

Fix error report of DSElasticAgent._set_master_addr_port() (#4985)

RobinDong committed 1 year ago

Verified d2e9adce

Update falcon fused type order (#5007)

Yejing-Lai committed 1 year ago

Verified 62afafe8

Newer Older