accelerate

Parallelism config + TP + HSDP + BYODM (Bring Your Own Device Mesh)

#3682

Merged