Allow compressed-tensors quantized model to be trained #34520
ArthurZucker
merged
20 commits into
huggingface:main
from
neuralmagic:nm-train-quantized-models-from-compressed-tensors
populate quantization_config for kv-cache-scheme only configs
dc19bc16
make compressed-tensors quantized models trainable
b8a2d49a
horheynm
changed the title
Merge branch 'main' into nm-train-quantized-models-from-compressed-te…
36b88994
populate versions on quant config
a8a757a8
pass oneshot then finetune
95a36a37
remove breakpoint
4cf4fe2d
SunMarc comments and fix to_dict logic
dae8b3ce
Merge branch 'main' into nm-train-quantized-models-from-compressed-te…
07aac0f6
Merge branch 'main' into nm-train-quantized-models-from-compressed-te…
7bf07a86
Merge branch 'main' into nm-train-quantized-models-from-compressed-te…
dfbf2828
lint
43870531
Merge branch 'nm-train-quantized-models-from-compressed-tensors' of g…
abbc62b7
Merge branch 'main' into nm-train-quantized-models-from-compressed-te…
74c127fd
lint
e4db2071
test
dca9c555
dsikka
commented
on 2024-11-18
comment
725066ac
Merge branch 'main' into nm-train-quantized-models-from-compressed-te…
c11c96e8
comments'
a3b289fe
Merge branch 'nm-train-quantized-models-from-compressed-tensors' of g…
90a92f17
Merge branch 'main' into nm-train-quantized-models-from-compressed-te…
c3e3cecb
SunMarc
approved these changes
on 2024-11-21
ArthurZucker
commented
on 2024-11-25
ArthurZucker
approved these changes
on 2024-11-28
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub