transformers
Batch Rebalance Data Sampler
#47340
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
32
Changes
View On
GitHub
Batch Rebalance Data Sampler
#47340
SunMarc
merged 32 commits into
huggingface:main
from
delock:gma/batch_rebalance_sampler
Add BatchRebalanceSampler for cost-balanced distributed training
d615c5c4
Add unit tests for BatchRebalanceSampler
6339637c
Fix: remove invalid super().__init__ call in BatchRebalanceSampler
63ddc2d3
Remove unused micro_batch_size param, fix silent data loss in max_tok…
db1c8ba1
Fix batch_rebalance sampling strategy: missing import and DataLoader …
9329e85c
Remove unused variable flagged by ruff F841
93cf3bcd
Fix import sort order for BatchRebalanceSampler (ruff I001)
b59c1416
Apply ruff format to changed files
dc6f4c4e
Replace dead count-adjustment code with explicit ValueError
a26d7cb3
Fix can_transfer accuracy and iterate all lo_candidates in rebalance
458f0107
Scale BatchRebalanceSampler iteration budget with effective batch size
c830f180
Merge branch 'main' into gma/batch_rebalance_sampler
9808497c
Merge branch 'main' into gma/batch_rebalance_sampler
4aa5d44f
sywangyi
commented on 2026-07-24
Fix BatchRebalanceSampler correctness issues in Trainer integration
4c699976
Fix UnboundLocalError on `sampler` for iterable datasets in Trainer._…
45f8109d
Merge branch 'main' into gma/batch_rebalance_sampler
c9363862
SunMarc
requested a review
from
sywangyi
115 days ago
sywangyi
commented on 2026-07-31
sywangyi
commented on 2026-07-31
Address sywangyi review: effective_batch_size DP fix, bounded tail pa…
c21f3d1c
Print summary line in batch_rebalance_ddp worker script
8c385a01
Trim redundant rationale from effective_batch_size comment
b70bac62
Merge remote-tracking branch 'origin/main' into gma/batch_rebalance_s…
112fdd46
Apply ruff format to test_trainer_distributed_ddp
814b8755
sywangyi
commented on 2026-08-05
Pad tail by wrapping order when dataset is smaller than K
462c4fd3
sywangyi
approved these changes on 2026-08-06
SunMarc
requested a review
from
SunMarc
106 days ago
SunMarc
commented on 2026-08-11
Address comments
942f8d79
Remove batch_rebalance_alpha and batch_rebalance_max_tokens args
2f2b6cc4
Simplify BatchRebalanceSampler for readability
5b4d8b69
Consolidate batch_rebalance tests and extend the DDP e2e to two epochs
e812d47b
Merge branch 'main' into gma/batch_rebalance_sampler
a6171a96
Merge branch 'main' into gma/batch_rebalance_sampler
5bb6d341
SunMarc
approved these changes on 2026-08-25
Reuse train.py for the batch_rebalance DDP test
1b857245
SunMarc
approved these changes on 2026-08-26
[docs] Add batch_rebalance sampling strategy to the training guide
7365e356
SunMarc
enabled auto-merge
85 days ago
SunMarc
approved these changes on 2026-08-27
stevhliu
commented on 2026-08-27
[docs] Move batch_rebalance sampling guide to trainer_recipes
f789a071
disabled auto-merge
85 days ago
Head branch was pushed to by a user without write access
Merge branch 'main' into gma/batch_rebalance_sampler
01e8566f
SunMarc
enabled auto-merge
80 days ago
SunMarc
merged
4c0dafa1
into main
80 days ago
Login to write a write a comment.
Login via GitHub
Reviewers
SunMarc
sywangyi
stevhliu
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub