add gptq and awq int4 support in intel platform
61fe28e8
fix ci failure
dd3fb817
set kv cache dtype
645369be
refine the code according to the review command
f36c9a68
Simplifying conditionals + reverting integration tests values.
3e12402a
Unused import
ba7197c0
Fix redundant import.
7b291355
Revert change after rebase.
5ca6da15
Upgrading the tests (TP>1 fix changes to use different kernels.)
8673bb05
Narsil
commented
on 2024-10-18
Update server/text_generation_server/layers/gptq/__init__.py
0229c71b
Login to write a write a comment.
Login via GitHub