text-generation-inference
Retrieve the correct cached model batch size in Neuron config checker for Neuron Backend
#3300
Open
Overview
Commits
1
Changes
View On GitHub

Retrieve the correct cached model batch size in Neuron config checker for Neuron Backend #3300

jimburtoft wants to merge 1 commit into huggingface:main from jimburtoft:patch-2
jimburtoft
jimburtoft Change batch size sort in Neuron config
3c55c053
jimburtoft jimburtoft changed the title Retrieve the correct cached model in Neuron config checker for Neuron Backend Retrieve the correct cached model batch size in Neuron config checker for Neuron Backend 153 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum