text-generation-inference
[Gaudi] Fix the OOM issue of Llama-4-Scout-17B-16E-Instruct
#3245
Merged

[Gaudi] Fix the OOM issue of Llama-4-Scout-17B-16E-Instruct #3245

regisss merged 1 commit into huggingface:main from yuanwu2017:instruct
yuanwu2017
yuanwu2017 Fix the OOM issue of Llama-4-Scout-17B-16E-Instruct
fb104d8b
yuanwu2017
yuanwu2017
regisss
regisss approved these changes on 2025-05-29
regisss regisss merged 70217ac3 into main 204 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone