auto-round
Keep the original checkpoint key names and fix Qwen4 vLLM inference
#2327
Merged
Overview
Commits
17
Changes
View On GitHub

Keep the original checkpoint key names and fix Qwen4 vLLM inference #2327

wenhuach21 merged 17 commits into main from fix_qwen4
wenhuach21
wenhuach21 fix
62a687c9
wenhuach21 wenhuach21 changed the title fix Fix Qwen4 layer_type changed by Transformers, causing vLLM inference failure 46 days ago
AutoRoundBot
azure-pipelines
wenhuach21 wenhuach21 requested a review from lvliang-intel lvliang-intel 46 days ago
wenhuach21 wenhuach21 removed review request from lvliang-intel lvliang-intel 46 days ago
wenhuach21 wenhuach21 requested a review from xin3he xin3he 46 days ago
wenhuach21 wenhuach21 requested a review from lvliang-intel lvliang-intel 46 days ago
wenhuach21 update
de9384fd
AutoRoundBot
azure-pipelines
wenhuach21 Merge branch 'main' into fix_qwen4
832e543d
AutoRoundBot
azure-pipelines
wenhuach21 update
99e0afa4
wenhuach21 Merge branch 'fix_qwen4' of https://github.com/intel/auto-round into …
e9373df8
AutoRoundBot
azure-pipelines
AutoRoundBot
wenhuach21 update
85df591f
wenhuach21 update
d172dd58
AutoRoundBot
azure-pipelines
wenhuach21 try to fix rename issue
dd0bb782
AutoRoundBot
azure-pipelines
wenhuach21 try to fix rename issue
d8554822
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
1795e7f9
AutoRoundBot
azure-pipelines
wenhuach21 try to fix ngram shard rename issue
e9a2b541
wenhuach21 Merge branch 'fix_qwen4' of https://github.com/intel/auto-round into …
09745d3c
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
e5f4f2ea
AutoRoundBot
azure-pipelines
wenhuach21 wenhuach21 changed the title Fix Qwen4 layer_type changed by Transformers, causing vLLM inference failure Keep the original checkpoint key names and fix Qwen4 vLLM inference 45 days ago
wenhuach21 update ignore layers
98de3ed5
wenhuach21 Merge branch 'fix_qwen4' of https://github.com/intel/auto-round into …
043b00fb
AutoRoundBot
azure-pipelines
wenhuach21 update readme
670e61b0
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
e0c009e0
wenhuach21 wenhuach21 merged aba0abdd into main 44 days ago
wenhuach21 wenhuach21 deleted the fix_qwen4 branch 44 days ago
AutoRoundBot

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum