DeepSpeed
Rearrange inference OPS and stop using builder.load
#5490
Merged
Overview
Commits
64
Changes
View On GitHub

Rearrange inference OPS and stop using builder.load #5490

loadams merged 64 commits into deepspeedai:master from oelayan7:rearrange_ops
oelayan7
oelayan7 oelayan7 requested a review from mrwyattii mrwyattii 1 year ago
oelayan7 oelayan7 requested a review from tjruwase tjruwase 1 year ago
oelayan7 oelayan7 requested a review from awan-10 awan-10 1 year ago
oelayan7 oelayan7 requested a review from arashb arashb 1 year ago
oelayan7 oelayan7 requested a review from loadams loadams 1 year ago
loadams
lekurile
oelayan7 Add missing inference ops
a4cec16f
oelayan7 Add missing fallback implementation for inference ops
49556539
oelayan7 Use ops directly, stop using builder.load to use ops
aed7204f
oelayan7 Add inference builder for cpu
c6f48c98
oelayan7 oelayan7 force pushed from 3034ce81 to c6f48c98 1 year ago
jomayeri Merge branch 'master' into rearrange_ops
e25d7b5a
oelayan7 add missing args to softmax context
b6ca9d89
oelayan7
lekurile Merge branch 'master' into rearrange_ops
3f2cf1e2
lekurile
loadams Merge branch 'master' into rearrange_ops
2f55610a
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
2e9db193
oelayan7 Revert "Add inference builder for cpu"
21ace48f
oelayan7 remove = from fstrings op, and unimplemented workspace
cd932989
oelayan7
oelayan7 DS transformer set correct instance
11172868
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
c8ddcba8
loadams Merge branch 'master' into rearrange_ops
6fe92d02
loadams Merge branch 'master' into rearrange_ops
7200aa8d
loadams Merge branch 'master' into rearrange_ops
e73e3b20
loadams
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
994ad365
oelayan7 fix CI issues
e7c8b38f
oelayan7
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
2bd46e22
oelayan7 remove irrelevant assert
e08e7a53
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
77ededb8
oelayan7
loadams
loadams Merge branch 'master' into rearrange_ops
268de18c
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
ec98a78f
oelayan7 Fix cuda compilation issue
6cea08f1
oelayan7 Fix cuda compilation issue
85a90d33
tjruwase Merge branch 'master' into rearrange_ops
cf837b39
tjruwase tjruwase removed review request from arashb arashb 1 year ago
tjruwase tjruwase removed review request from mrwyattii mrwyattii 1 year ago
tjruwase tjruwase requested a review from lekurile lekurile 1 year ago
lekurile Merge branch 'master' into rearrange_ops
d05a939e
tjruwase Merge branch 'master' into rearrange_ops
cde5a5f1
tjruwase Merge branch 'master' into rearrange_ops
96e8d359
tjruwase Merge branch 'master' into rearrange_ops
5fd5c086
loadams Merge branch 'master' into rearrange_ops
1d506dbe
loadams
tjruwase Merge branch 'master' into rearrange_ops
58f60f6b
tjruwase
tjruwase commented on 2024-08-21
tjruwase
tjruwase commented on 2024-08-21
tjruwase Merge branch 'master' into rearrange_ops
c1eb49a7
tjruwase Merge branch 'master' into rearrange_ops
ddd0021e
oelayan7 add verbos flag to add prints in workflow DS mii
6d112b17
tjruwase
tjruwase approved these changes on 2024-09-03
oelayan7 check if BF16 available before including the headers
2d314405
loadams Merge branch 'master' into rearrange_ops
cde622af
loadams Merge branch 'master' into rearrange_ops
be060c95
loadams Merge branch 'master' into rearrange_ops
b15b1269
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
1e5aafc4
loadams Merge branch 'master' into rearrange_ops
58bd5611
loadams Merge branch 'master' into rearrange_ops
8cb1dc88
loadams Merge branch 'master' into rearrange_ops
3aab92c0
loadams Merge branch 'master' into rearrange_ops
5bbe0409
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
04f8b509
oelayan7 revert workspace changes
1d9aeaf6
oelayan7 add comment to trigger nv-mii job
191edd72
oelayan7 trigger ci
ac5f1a65
oelayan7 revert changes that triggered mii job
39b9b8cf
oelayan7 Revert "revert workspace changes"
fc74edda
oelayan7 Add is_allocated to workspace
fdcf2ea3
oelayan7 add reset_cache to workspace
a01ed492
loadams
loadams approved these changes on 2024-09-25
loadams
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
d6a8c80a
loadams Merge branch 'master' into rearrange_ops
a681bb68
loadams Merge branch 'master' into rearrange_ops
1ea0c816
loadams Merge branch 'master' into rearrange_ops
dc6e04e2
loadams Merge branch 'master' into rearrange_ops
dc134548
oelayan7 Add missing call to allocate_workspace
026c62fb
oelayan7 add retake workspace func
ad67ede1
oelayan7 Merge branch 'microsoft:master' into rearrange_ops
b1a118a9
oelayan7 Merge branch 'master' into rearrange_ops
7a584850
oelayan7 oelayan7 requested a review from tohtana tohtana 1 year ago
oelayan7 oelayan7 requested a review from jomayeri jomayeri 1 year ago
loadams Merge branch 'master' into rearrange_ops
a56848a1
loadams Merge branch 'master' into rearrange_ops
dee13b91
loadams loadams enabled auto-merge 1 year ago
loadams Merge branch 'master' into rearrange_ops
89cdf112
loadams loadams merged 645639bc into master 1 year ago
oelayan7 oelayan7 deleted the rearrange_ops branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum