PR #3223 Enable Llama4 for gaudi backend

Enable Llama4 for gaudi backend #3223

regisss merged 18 commits into huggingface:main from yuanwu2017:llama4

Enable llama4

3482d7ca

Fix crash

ccddbba7

Add save

dafc597a

Debug accuracy issue

2dadceaf

Fix experts issue

a3967a57

Fix the accuracy issue

1a5ff1dc

Fix the image-to-text accuray issue

a27039bc

Clean the code

f0dac1de

Clean the code

3aa88233

Remove unnecessary modifications

4e95db30

yuanwu2017 marked this pull request as draft 1 year ago

Remove

d98116db

Fix the errors of pre-commit

7533b993

refine

50ecfc62

Fix the image_token_id issue

f5aaa18d

Install new transformers

cfcbd80f

yuanwu2017 marked this pull request as ready for review 1 year ago

Fix the import error

f0acbbf1

Fix the RotaryEmbedding

9414bcca

regisss commented on 2025-05-12

Add the latest transformers

e14a451d

regisss approved these changes on 2025-05-13

regisss merged 18cbecfb into main 1 year ago

Reviewers

regisss

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

text-generation-inference Enable Llama4 for gaudi backend #3223 Merged

Enable Llama4 for gaudi backend #3223

text-generation-inference
Enable Llama4 for gaudi backend
#3223

Merged