DeepSpeed
Enable dynamic shapes for pipeline parallel engine inputs
#5481
Merged

Enable dynamic shapes for pipeline parallel engine inputs #5481

tohtana
allow dynamic shape of inputs to pp engine
679ac4e2
Merge branch 'master' into tohtana/pp_dynamic_shape
3e15fae0
improve buffer allocation
b3c07504
fix condition to extend cache
822aeeef
consolidate communication for tensor metadata
9f96ad40
tohtana Merge branch 'master' into tohtana/pp_dynamic_shape
c47ef5a7
tohtana Merge branch 'microsoft:master' into tohtana/pp_dynamic_shape
85633e63
tohtana tohtana marked this pull request as ready for review 2 years ago
tohtana tohtana requested a review from duli2012 duli2012 2 years ago
tohtana Merge branch 'master' into tohtana/pp_dynamic_shape
652c148f
tohtana Merge branch 'master' into tohtana/pp_dynamic_shape
428dbe19
fix error after auto merge
4c7910bd
tjruwase
tjruwase commented on 2024-07-25
tjruwase
tjruwase commented on 2024-07-25
duli2012
duli2012 commented on 2024-07-26
tohtana Merge branch 'master' into tohtana/pp_dynamic_shape
efa36b39
add test for dynamic shape support
b6aecacc
refactor duplicated code
cb99e11a
tohtana tohtana requested a review from loadams loadams 1 year ago
remove unreachable code
bab2247b
add assertions
e9b03cfd
add comments and remove unused method
7fe47d0e
tohtana Merge branch 'master' into tohtana/pp_dynamic_shape
33453bf2
tohtana
tjruwase Merge branch 'master' into tohtana/pp_dynamic_shape
99257826
tjruwase
tjruwase approved these changes on 2024-08-16
loadams loadams merged 1ab1928d into master 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone