xla
Add feature to increase the number of host to device transfer threads
#4693

Merged

Add feature to increase the number of host to device transfer threads #4693

miladm merged 9 commits into master from dataloader_change

chandrasekhard2 requested a review from

miladm 3 years ago

chandrasekhard2 requested a review from

JackCaoG 3 years ago

JackCaoG requested a review from

will-cromar 3 years ago

JackCaoG commented on 2023-02-24

yeounoh commented on 2023-02-24

JackCaoG approved these changes on 2023-02-25

miladm assigned

chandrasekhard2 3 years ago

miladm added performance

miladm requested changes on 2023-02-27

will-cromar commented on 2023-02-27

JackCaoG requested a review from

will-cromar 3 years ago

JackCaoG requested a review from

miladm 3 years ago

JackCaoG commented on 2023-03-06

JackCaoG commented on 2023-03-07

JackCaoG approved these changes on 2023-03-07

Add feature to increase the number of host to device transfer threads

b0c748f4

Revert test set batch_size to 64

feeea8e1

Rename the config name to OPTIMIZED_KWARGS_v4

ebfc74c3

Change description to v4 instead of just v4-8 as this config imporves…

3cde6498

remove extra line

bb513b74

Add flag to switch v4 optimized config

2e4c7b7e

Modify name to more generalized way to keep it open for v5 config as …

66cbf693

Add flexibility to define multiple configs based on TPU versions

e48ea2a9

Keep the command consistent

40f55a2b

chandrasekhard2 force pushed from fde638bc to 40f55a2b 3 years ago

miladm approved these changes on 2023-03-09

miladm merged ea135c6d into master 3 years ago

Reviewers

miladm

JackCaoG

will-cromar

yeounoh

Assignees

chandrasekhard2

Labels

performance

Milestone

No milestone

xla Add feature to increase the number of host to device transfer threads #4693 Merged

Add feature to increase the number of host to device transfer threads #4693

xla
Add feature to increase the number of host to device transfer threads
#4693

Merged