Update src/accelerate/inference.py

Commit

2 years ago

Update src/accelerate/inference.py Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>