xla
Enable xla:gpu autocast for bfloat16 if not restricted
#5570

Merged

Enable xla:gpu autocast for bfloat16 if not restricted #5570

will-cromar merged 11 commits into master from spmd_amp_gpu

Enable autocast for XLA:GPU

01834d7d

yeounoh assigned

yeounoh 2 years ago

yeounoh requested a review from

JackCaoG 2 years ago

yeounoh requested a review from

miladm 2 years ago

yeounoh requested a review from

cowanmeg 2 years ago

yeounoh changed the title ~~Enable autocast for XLA:GPU~~ Enable xla autocast for XLA:GPU 2 years ago

yeounoh added DO_NOT_MERGE_YET

yeounoh marked this pull request as draft 2 years ago

yeounoh removed review request from

cowanmeg 2 years ago

linter fix

5e43b41b

yeounoh force pushed from a116ae38 to 5e43b41b 2 years ago

XLA autocast test for GPU and TPU

ac04616e

linter fix

22076afd

yeounoh force pushed from c2204b64 to 04bc25e2 2 years ago

Ensure that xla autocast is properly enabled for GPU and does not cra…

08f271d2

yeounoh force pushed from 04bc25e2 to 08f271d2 2 years ago

yeounoh force pushed from 3a9b509b to a55263f5 2 years ago

yeounoh force pushed from a55263f5 to 17d614ee 2 years ago

yeounoh force pushed from 17d614ee to 0a0365b7 2 years ago

linter fix

06fb4d41

yeounoh force pushed from 0a0365b7 to 06fb4d41 2 years ago

Add tests

34464420

yeounoh force pushed from 34063e67 to c923fd92 2 years ago

Support bf16

d940e7b9

yeounoh force pushed from c923fd92 to d940e7b9 2 years ago

yeounoh force pushed from ebbbd32f to 5feb91f3 2 years ago

yeounoh force pushed from 5feb91f3 to daef59b7 2 years ago

yeounoh force pushed from daef59b7 to 61dfad3b 2 years ago

yeounoh force pushed from 61dfad3b to ca70b11f 2 years ago

yeounoh force pushed from ca70b11f to 3e3e818a 2 years ago

yeounoh force pushed from 3e3e818a to 9cf9a216 2 years ago

yeounoh force pushed from 9cf9a216 to 98dec3d7 2 years ago

yeounoh marked this pull request as ready for review 2 years ago

linter fix

4127fceb

yeounoh force pushed from 98dec3d7 to 4127fceb 2 years ago

exclude unsupported test cases

9f18b2b0

yeounoh removed DO_NOT_MERGE_YET

yeounoh changed the title ~~Enable xla autocast for XLA:GPU~~ Enable xla:gpu autocast for bfloat16 if not restricted 2 years ago

increase GPU test timeout to 300

9d725f42

JackCaoG commented on 2023-09-15

JackCaoG approved these changes on 2023-09-15

will-cromar merged 64bbf151 into master 2 years ago

baoleai commented on 2023-09-15

Reviewers

JackCaoG

baoleai

miladm

Assignees

yeounoh

Labels

None yet

Milestone

No milestone

xla Enable xla:gpu autocast for bfloat16 if not restricted #5570 Merged

Enable xla:gpu autocast for bfloat16 if not restricted #5570

xla
Enable xla:gpu autocast for bfloat16 if not restricted
#5570

Merged