accelerate
feat: Add true multi-node inference support for device_map="auto" (#1890)
#4066

Open

feat: Add true multi-node inference support for device_map="auto" (#1890) #4066

Saurav-Gupta-13 wants to merge 1 commit into huggingface:main from Saurav-Gupta-13:feature/multi-node-device-map

feat: implement multi-node device_map distributed inference using tor…

95aca692

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone