DeepSpeed
Variable batch size and LR scheduler
#7104
Merged
Overview
Commits
30
Changes
View On GitHub

Variable batch size and LR scheduler #7104

tjruwase merged 30 commits into deepspeedai:master from bm-synth:variable_batch_size_and_lr_2
bm-synth
bm-synth copy past of all files from PR 7020
ff214de6
bm-synth copy/paste of all files from PR 7020 and 7102 to avoid having rebase and
53a3b1a1
bm-synth Merge branch 'variable_batch_size_and_lr_2' of github.com:bm-synth/De…
28b84183
bm-synth bm-synth marked this pull request as ready for review 1 year ago
bm-synth bm-synth requested a review from tjruwase tjruwase 1 year ago
bm-synth bm-synth requested a review from tohtana tohtana 1 year ago
bm-synth bm-synth requested a review from loadams loadams 1 year ago
bm-synth bm-synth requested a review from hwchen2017 hwchen2017 1 year ago
bm-synth bm-synth requested a review from jomayeri jomayeri 1 year ago
bm-synth merge conflicts
810d89b4
bm-synth bm-synth requested a review from GuanhuaWang GuanhuaWang 1 year ago
bm-synth bm-synth force pushed from c5615c31 to 810d89b4 1 year ago
tjruwase
tjruwase commented on 2025-03-04
tjruwase
tjruwase commented on 2025-03-04
tjruwase
tjruwase commented on 2025-03-04
tjruwase
tjruwase commented on 2025-03-04
tjruwase
tjruwase commented on 2025-03-04
bm-synth corrected arguments in batch_by_seqlens
6e6f04c2
bm-synth corrected alias for deepspeed team
588e982c
bm-synth Update deepspeed/runtime/data_pipeline/data_sampling/variable_batch_s…
8b44bfd4
bm-synth Merge branch 'variable_batch_size_and_lr_2' of github.com:bm-synth/De…
ae9c667a
bm-synth Merge branch 'master' into variable_batch_size_and_lr_2
42015d73
tjruwase
tjruwase approved these changes on 2025-03-04
tjruwase
bm-synth clang format with the correct version
241eab84
bm-synth Merge branch 'master' into variable_batch_size_and_lr_2
78d80cfc
bm-synth
bm-synth Merge branch 'master' into variable_batch_size_and_lr_2
37b62e53
tjruwase Merge branch 'master' into variable_batch_size_and_lr_2
91a1d286
bm-synth Merge branch 'master' into variable_batch_size_and_lr_2
1aee19eb
bm-synth moved deepspeed/runtime/data_pipeline/data_sampling/variable_batch_si…
cbfed15f
tjruwase Merge branch 'master' into variable_batch_size_and_lr_2
9fbe3d15
tjruwase Merge branch 'master' into variable_batch_size_and_lr_2
1331caf6
loadams Merge branch 'master' into variable_batch_size_and_lr_2
3c1ae095
tjruwase Merge branch 'master' into variable_batch_size_and_lr_2
50edd6fb
loadams Merge branch 'master' into variable_batch_size_and_lr_2
089d3238
loadams
tjruwase Merge branch 'master' into variable_batch_size_and_lr_2
ff0ea733
loadams Merge branch 'master' into variable_batch_size_and_lr_2
94528be3
loadams
bm-synth Merge branch 'variable_batch_size_and_lr_2' of github.com:bm-synth/De…
10f5de52
bm-synth Merge branch 'master' into variable_batch_size_and_lr_2
7ae2e277
bm-synth Merge branch 'variable_batch_size_and_lr_2' of github.com:bm-synth/De…
2809be2b
bm-synth Merge branch 'master' into variable_batch_size_and_lr_2
74eaf12c
bm-synth bug fix for missing key 'data_sampling' on test_deepspeed.py
1ca11086
bm-synth Merge branch 'variable_batch_size_and_lr_2' of github.com:bm-synth/De…
731d3fd6
bm-synth
bm-synth cleaner implementation of previous bug fix on missing key
8c856c78
bm-synth safer implementaiton that doesnt change param_dict
dc00acc4
bm-synth
tjruwase
tjruwase tjruwase merged 20f988ea into master 1 year ago
bm-synth bm-synth deleted the variable_batch_size_and_lr_2 branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum