PR #523 Add support for downcasting bf16 on TPUs

Add support for downcasting bf16 on TPUs #523

muellerzr merged 7 commits into main from downcast

Allow for downcast

0cd3b0ac

muellerzr added enhancement

muellerzr added TPU

muellerzr requested a review from

sgugger 3 years ago

sgugger commented on 2022-07-15

Refactor to be config only

727dec57

Fin

af9c83b3

Fix config default

473cc5f4

MOve to cluster config

c6095801

Add to state

6759b25d

Use getattr

8a4c3fef

muellerzr requested a review from

sgugger 3 years ago

sgugger approved these changes on 2022-07-20

muellerzr merged 158acdd2 into main 3 years ago

muellerzr deleted the downcast branch 3 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

enhancement TPU

Milestone

No milestone