transformers
Batch Rebalance Data Sampler
#47340
Merged

Batch Rebalance Data Sampler #47340

delock
delock Add BatchRebalanceSampler for cost-balanced distributed training
d615c5c4
delock Add unit tests for BatchRebalanceSampler
6339637c
delock Fix: remove invalid super().__init__ call in BatchRebalanceSampler
63ddc2d3
delock Remove unused micro_batch_size param, fix silent data loss in max_tok…
db1c8ba1
delock Fix batch_rebalance sampling strategy: missing import and DataLoader …
9329e85c
delock Remove unused variable flagged by ruff F841
93cf3bcd
delock Fix import sort order for BatchRebalanceSampler (ruff I001)
b59c1416
delock Apply ruff format to changed files
dc6f4c4e
delock Replace dead count-adjustment code with explicit ValueError
a26d7cb3
delock Fix can_transfer accuracy and iterate all lo_candidates in rebalance
458f0107
delock Scale BatchRebalanceSampler iteration budget with effective batch size
c830f180
delock
delock
delock Merge branch 'main' into gma/batch_rebalance_sampler
9808497c
github-actions
delock Merge branch 'main' into gma/batch_rebalance_sampler
4aa5d44f
sywangyi
sywangyi commented on 2026-07-24
sywangyi
sywangyi
delock Fix BatchRebalanceSampler correctness issues in Trainer integration
4c699976
delock
delock Fix UnboundLocalError on `sampler` for iterable datasets in Trainer._…
45f8109d
delock Merge branch 'main' into gma/batch_rebalance_sampler
c9363862
SunMarc SunMarc requested a review from sywangyi sywangyi 115 days ago
sywangyi
sywangyi commented on 2026-07-31
sywangyi
sywangyi commented on 2026-07-31
sywangyi
delock Address sywangyi review: effective_batch_size DP fix, bounded tail pa…
c21f3d1c
delock Print summary line in batch_rebalance_ddp worker script
8c385a01
delock Trim redundant rationale from effective_batch_size comment
b70bac62
delock Merge remote-tracking branch 'origin/main' into gma/batch_rebalance_s…
112fdd46
delock Apply ruff format to test_trainer_distributed_ddp
814b8755
delock
sywangyi
sywangyi commented on 2026-08-05
delock Pad tail by wrapping order when dataset is smaller than K
462c4fd3
sywangyi
sywangyi approved these changes on 2026-08-06
sywangyi
delock
SunMarc SunMarc requested a review from SunMarc SunMarc 106 days ago
SunMarc
SunMarc
SunMarc commented on 2026-08-11
delock Address comments
942f8d79
delock Remove batch_rebalance_alpha and batch_rebalance_max_tokens args
2f2b6cc4
delock Simplify BatchRebalanceSampler for readability
5b4d8b69
delock Consolidate batch_rebalance tests and extend the DDP e2e to two epochs
e812d47b
delock
delock Merge branch 'main' into gma/batch_rebalance_sampler
a6171a96
delock Merge branch 'main' into gma/batch_rebalance_sampler
5bb6d341
SunMarc
SunMarc approved these changes on 2026-08-25
delock Reuse train.py for the batch_rebalance DDP test
1b857245
delock
SunMarc
SunMarc approved these changes on 2026-08-26
HuggingFaceDocBuilderDev
delock [docs] Add batch_rebalance sampling strategy to the training guide
7365e356
delock
SunMarc SunMarc enabled auto-merge 85 days ago
SunMarc
SunMarc approved these changes on 2026-08-27
stevhliu
stevhliu commented on 2026-08-27
delock [docs] Move batch_rebalance sampling guide to trainer_recipes
f789a071
disabled auto-merge 85 days ago
Head branch was pushed to by a user without write access
delock
SunMarc Merge branch 'main' into gma/batch_rebalance_sampler
01e8566f
github-actions
SunMarc SunMarc enabled auto-merge 80 days ago
SunMarc SunMarc merged 4c0dafa1 into main 80 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone