accelerate

b565a6c5 - device agnostic deepspeed&fsdp testing (#2235)

device agnostic deepspeed&fsdp testing (#2235) * device agnostic deepspeed testing * device agnostic fsdp testing * fix failing deepspeed test * make style --------- Co-authored-by: Zach Mueller <muellerzr@gmail.com>