DeepSpeed
Fix: Adapt Llama injection policy for newer transformers versions
#7443

Merged

Fix: Adapt Llama injection policy for newer transformers versions #7443

stas00 merged 5 commits into deepspeedai:master from huanyuqu:fix-llama-injection-compat

huanyuqu requested a review from

hwchen2017 1 year ago

huanyuqu requested a review from

loadams 1 year ago

huanyuqu force pushed from dab455e9 to 3a605b7a 1 year ago

loadams requested a review from

stas00 1 year ago

stas00 approved these changes on 2025-07-23

huanyuqu force pushed from f9e9e9f5 to 23af0d25 1 year ago

huanyuqu requested a review from

tjruwase 1 year ago

huanyuqu requested a review from

tohtana 1 year ago

sfc-gh-sbekman commented on 2025-07-24

Fix: Adapt Llama injection policy for newer transformers versions

102f8b16

Test: Add unit test for Llama kernel injection

ca4036ff

Test: Fix Llama injection test and use a smaller model

e327ca37

huanyuqu force pushed from b1358760 to e327ca37 1 year ago

style: Apply formatting fixes for yapf and whitespace

e1807043

test: Switch to Felladrin/Llama-160M for injection test

61a71652

stas00 commented on 2025-07-26

stas00 merged 092625c7 into master 1 year ago

Reviewers

stas00

sfc-gh-sbekman

hwchen2017

loadams

tjruwase

tohtana

Assignees

No one assigned

Labels

None yet

Milestone

No milestone