DeepSpeed
Inference Checkpoints
#4620
Merged
Overview
Commits
22
Changes
View On GitHub

Inference Checkpoints #4620

cmikeh2 merged 22 commits into cholmes/checkpoints-inference-v2-2 from cholmes/checkpoints-inference-v2
cmikeh2
jeffra DeepSpeed-FastGen (#622)
49cea1ab
cmikeh2 Merge branch 'master' into staging-inference-v2-5
74b6f763
cmikeh2 Isolate src code and tests for faster CI
61ad33db
cmikeh2 Local unit tests passing
c1b1c2a2
cmikeh2 Merge branch 'master' into cholmes/isolate-src-code
32b3cbdd
cmikeh2 Functional PoC
5ee1dd6b
cmikeh2 cmikeh2 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
cmikeh2 cmikeh2 requested a review from jeffra jeffra 2 years ago
cmikeh2 cmikeh2 requested a review from mrwyattii mrwyattii 2 years ago
cmikeh2 cmikeh2 requested a review from awan-10 awan-10 2 years ago
cmikeh2 cmikeh2 requested a review from arashb arashb 2 years ago
cmikeh2 cmikeh2 requested a review from tjruwase tjruwase 2 years ago
cmikeh2 cmikeh2 requested a review from loadams loadams 2 years ago
awan-10 Merge branch 'master' into cholmes/checkpoints-inference-v2
aff9b4c7
RezaYazdaniAminabadi
RezaYazdaniAminabadi commented on 2023-11-07
RezaYazdaniAminabadi
RezaYazdaniAminabadi commented on 2023-11-07
RezaYazdaniAminabadi
RezaYazdaniAminabadi commented on 2023-11-07
RezaYazdaniAminabadi
RezaYazdaniAminabadi
RezaYazdaniAminabadi commented on 2023-11-07
RezaYazdaniAminabadi Merge branch 'master' into cholmes/checkpoints-inference-v2
0faea352
cmikeh2
RezaYazdaniAminabadi
RezaYazdaniAminabadi commented on 2023-11-09
cmikeh2 Typing cleanup, remove private access
07a1c93e
fix a few things with writing and loading the new checkpoint
75b0e894
Merge branch 'cholmes/checkpoints-inference-v1' of github.com:microso…
573c21b8
cmikeh2 Add documentation on local methods
be3a27a3
cmikeh2 Scope out changes in unit tests from the CI
04e69076
cmikeh2 Fix failing unit tests, remove duplicates
d3434b3c
refactor build_hf_engine and expose a new engine-creation
27ba203d
small fix
91385d21
cmikeh2 Unit test implementation
89566b4e
cmikeh2 Formatting
295fa615
cmikeh2 Remove debug code
9b0bcca5
cmikeh2 Remove unused files
c65aebcd
cmikeh2 Engine factor documentation
ee87ca78
cmikeh2 cmikeh2 changed the base branch from master to cholmes/checkpoints-inference-v2-2 2 years ago
cmikeh2 cmikeh2 changed the base branch from cholmes/checkpoints-inference-v2-2 to master 2 years ago
cmikeh2 Merge branch 'master' into cholmes/checkpoints-inference-v2
b12d6bed
cmikeh2 cmikeh2 changed the base branch from master to cholmes/checkpoints-inference-v2-2 2 years ago
cmikeh2 cmikeh2 merged 19b25876 into cholmes/checkpoints-inference-v2-2 2 years ago
cmikeh2 cmikeh2 deleted the cholmes/checkpoints-inference-v2 branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum