microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into jomayeri/aio-type-mismatch

tjruwase committed 1 year ago

Verified c34f0072

fix type mismatch

jomayeri committed 1 year ago

c60990d0

Update version.txt after 0.15.0 release (#6403)

loadams committed 1 year ago

Verified ca4449e8

Fix torch check (#6402)

loadams committed 1 year ago

Verified 55b4cae8

Pydantic v2 migration (#5167)

mrwyattii committed 1 year ago

Verified 0a4457cc

Update to prepare for next release

loadams committed 1 year ago

8c2be7e9

[XPU] API align with new intel pytorch extension release (#6395)

YizhouZ committed 1 year ago

Verified b81b197e

add pip install cutlass version check (#6393)

GuanhuaWang committed 1 year ago

Verified 51da191e

Correct op_builder path to xpu files for trigger XPU tests (#6398)

loadams committed 1 year ago

Verified 0f0f231e

Add Japanese translation of Windows support blog (#6394)

tohtana committed 1 year ago

Verified 649b0785

fix fp16 Qwen2 series model to DeepSpeed-FastGen (#6028)

ZonePG committed 1 year ago

Verified e6fcc226

reduce cpu host overhead when using moe (#5578)

ranzhejiang committed 1 year ago

Verified 72608904

Long sequence parallelism (Ulysses) integration with HuggingFace (#5774)

samadejacobs committed 1 year ago

Verified 8b191d7c

GDS Swapping Fix (#6386)

jomayeri committed 1 year ago

Verified b65ea506

Update linear.py compatible with torch 2.4.0 (#5811)

terry-for-github committed 1 year ago

Verified 96393f56

Bug Fix 5880 (#6378)

jomayeri committed 1 year ago

Verified 3831d4b5

DeepSpeed on Window blog (#6364)

tjruwase committed 1 year ago

Verified 01fe65b3

Pin transformers version on nv-nightly (#6002)

loadams committed 1 year ago

Verified ba0ab713

DeepNVMe GDS (#5852)

jomayeri committed 1 year ago

Verified 5f0d177f

Add and Remove ZeRO 3 Hooks (#5658)

jomayeri committed 1 year ago

Verified c2e3a706

Enable dynamic shapes for pipeline parallel engine inputs (#5481)

tohtana committed 1 year ago

Verified 1ab1928d

Move inf_or_nan_tracker to cpu for cpu offload (#5826)

BacharL committed 1 year ago

Verified 4d4ff0ed

add moe topk(k>2) gate support (#5881)

inkcherry committed 1 year ago

Verified 9a3ede70

move pynvml install to setup.py (#5840)

Rohan138 committed 1 year ago

Verified 30428d03

Update version.txt after 0.14.5 release (#5982)

loadams committed 1 year ago

Verified 3f6df9a2

Allow accelerator to instantiate the device (#5255)

nelyahu committed 1 year ago

Verified eb07d41f

Update xpu-max1100.yml with new config and add some tests (#5668)

Liangliang-Ma committed 1 year ago

Verified 4ba49dda

Z3: optimizations for grad norm calculation and gradient clipping (#5504)

nelyahu committed 1 year ago

Verified 6eed634e

Add accelerator setup guides (#5827)

delock committed 1 year ago

Verified 19b01e1d

HPUAccelerator: remove support in set_visible_devices_envs (#5929)

nelyahu committed 1 year ago

Verified a8d1b44d

Older