accelerate
Allow for dynamic batch padding
#2352
Merged
Overview
Commits
20
Changes
View On GitHub

Allow for dynamic batch padding #2352

muellerzr merged 20 commits into pippy-integration-v2 from pippy-duplicates
muellerzr
muellerzr Allow for dynamic batch paddign
73e64a1e
muellerzr muellerzr requested a review from SunMarc SunMarc 2 years ago
muellerzr Fix test
3534a342
muellerzr
muellerzr commented on 2024-01-18
HuggingFaceDocBuilderDev
SunMarc
SunMarc commented on 2024-01-18
muellerzr Update src/accelerate/inference.py
0af31ff0
muellerzr Break early after the first valid bs is found
b1c565d0
muellerzr Less slicy-dicy
a98e51b0
muellerzr Test cv model
8a452c18
muellerzr muellerzr requested a review from SunMarc SunMarc 2 years ago
SunMarc
SunMarc commented on 2024-01-18
muellerzr Start, need to test
2e23e1e9
muellerzr Use dataloader-like logic
c7800f50
muellerzr Refactor to utils
1a9181c4
muellerzr muellerzr requested a review from SunMarc SunMarc 2 years ago
SunMarc
SunMarc commented on 2024-01-19
muellerzr With tests
fed86c4c
muellerzr Update the source
fcc72a37
muellerzr Clean
7045a290
muellerzr bs=1 case
6167d0ba
muellerzr Add test
7e958024
SunMarc add some failing test
57277673
SunMarc
SunMarc commented on 2024-01-24
muellerzr Almost working version
6864314c
muellerzr Much cleaner implementation
a45e7f96
muellerzr Use pad_input_tensor
136f495c
muellerzr All tests passing!
5970e8e3
muellerzr Do it at tracing too
6e1e02f6
muellerzr
muellerzr commented on 2024-01-25
muellerzr muellerzr merged dac1daa9 into pippy-integration-v2 2 years ago
muellerzr muellerzr deleted the pippy-duplicates branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum