xla
Patch RNG for better memory utilization in dropout layers
#5710

Merged

Patch RNG for better memory utilization in dropout layers #5710

yeounoh merged 6 commits into master from patch_rng_xla

yeounoh requested a review from

JackCaoG 1 year ago

yeounoh assigned

yeounoh 1 year ago

yeounoh changed the title ~~Patch RNG~~ Patch RNG for better memory utilization in dropout layers 1 year ago

yeounoh force pushed from 3c06cd2e to 3c3ef36d 1 year ago

yeounoh marked this pull request as draft 1 year ago

yeounoh added DO_NOT_MERGE

JackCaoG approved these changes on 2023-10-17

Support new u8 rng bit

1573afe9

Enable u8 rng-bit-generator with downcast

fa57380f

Use local xla repo

b1bb498c

Use BF16 values if downcast for uniform dist is set.

b3e8c4c3

Rebase and disable local OpenXLA repo for me

5988f45a

yeounoh force pushed from 3c3ef36d to 5988f45a 1 year ago

yeounoh removed DO_NOT_MERGE

yeounoh marked this pull request as ready for review 1 year ago

yeounoh added performance

yeounoh force pushed from a9132b96 to 89eb61ee 1 year ago

yeounoh force pushed from 89eb61ee to df85d092 1 year ago

yeounoh force pushed from df85d092 to e26a3eea 1 year ago

add a unit test

6f3dda6f

yeounoh force pushed from e26a3eea to 6f3dda6f 1 year ago

yeounoh merged 8f121c31 into master 1 year ago

Reviewers

JackCaoG

Assignees

yeounoh

Labels

performance

Milestone

No milestone