xla
Allows Llama 3 example to run on TPUs with multiple VMs (16+) (XLA2)
#7888
Merged
Merged
Allows Llama 3 example to run on TPUs with multiple VMs (16+) (XLA2) #7888
qihqi
merged
4 commits into
pytorch:master
from
xla2_llama_example_multiple_vms
added support for device put on shraded tensors
b65ad868
added sharding to input tensors during compile and handled empty firs…
e21e6c02
reverted script import module hirerchy to mirror 'main' branch
f72062f2
Merge branch 'master' of github.com:zmelumian/xla into xla2_llama_exa…
01d7ecfa
qihqi
approved these changes
on 2024-08-20
Login to write a write a comment.
Login via GitHub