xla
Patch RNG for better memory utilization in dropout layers
#5710

Merged

Patch RNG for better memory utilization in dropout layers #5710

yeounoh merged 6 commits into master from patch_rng_xla

yeounoh requested a review from

JackCaoG 2 years ago

yeounoh assigned

yeounoh 2 years ago

yeounoh changed the title ~~Patch RNG~~ Patch RNG for better memory utilization in dropout layers 2 years ago

yeounoh force pushed from 3c06cd2e to 3c3ef36d 2 years ago

yeounoh marked this pull request as draft 2 years ago

yeounoh added DO_NOT_MERGE

JackCaoG approved these changes on 2023-10-17

Support new u8 rng bit

1573afe9

Enable u8 rng-bit-generator with downcast

fa57380f

Use local xla repo

b1bb498c

Use BF16 values if downcast for uniform dist is set.

b3e8c4c3

Rebase and disable local OpenXLA repo for me

5988f45a

yeounoh force pushed from 3c3ef36d to 5988f45a 2 years ago

yeounoh removed DO_NOT_MERGE

yeounoh marked this pull request as ready for review 2 years ago

yeounoh added performance

yeounoh force pushed from a9132b96 to 89eb61ee 2 years ago

yeounoh force pushed from 89eb61ee to df85d092 2 years ago

yeounoh force pushed from df85d092 to e26a3eea 2 years ago

add a unit test

6f3dda6f

yeounoh force pushed from e26a3eea to 6f3dda6f 2 years ago

yeounoh merged 8f121c31 into master 2 years ago

Reviewers

JackCaoG

Assignees

yeounoh

Labels

performance

Milestone

No milestone