transformers
HIGGS Quantization Support
#34997
Merged
Overview
Commits
45
Changes
View On GitHub

HIGGS Quantization Support #34997

SunMarc merged 45 commits into huggingface:main from BlackSamorez:main
BlackSamorez
BlackSamorez higgs init
08b347cf
BlackSamorez working with crunches
14a0c82c
BlackSamorez per-model workspaces
1c5b9e7d
BlackSamorez style
9f2ef77e
BlackSamorez style 2
0ff58c37
BlackSamorez Merge branch 'huggingface:main' into main
2e9adc61
BlackSamorez tests and style
b6bad710
BlackSamorez higgs tests passing
c2bcf39b
BlackSamorez protecting torch import
a1e7b35c
Rocketknight1
BlackSamorez removed torch.Tensor type annotations
8f1a0a6a
BlackSamorez torch.nn.Module inheritance fix maybe
120f3600
BlackSamorez hide inputs inside quantizer calls
fdb71a5d
BlackSamorez style structure something
127c5f0b
SunMarc SunMarc requested a review from MekkCyber MekkCyber 1 year ago
BlackSamorez Merge branch 'main' into main
947a53dd
SunMarc
BlackSamorez
BlackSamorez Merge branch 'main' into main
e6ddc415
SunMarc
SunMarc commented on 2024-11-28
BlackSamorez Update src/transformers/quantizers/quantizer_higgs.py
0de97f14
BlackSamorez reworked num_sms
1f08cb0b
BlackSamorez Merge branch 'main' of github.com:BlackSamorez/transformers
ed369be9
BlackSamorez Update src/transformers/integrations/higgs.py
96023ab6
MekkCyber
MekkCyber
MekkCyber commented on 2024-11-29
BlackSamorez revamped device checks
60ce44be
BlackSamorez docstring upd
81424439
BlackSamorez Update src/transformers/quantizers/quantizer_higgs.py
1d636ac0
BlackSamorez edited tests and device map assertions
66ece1d1
BlackSamorez Merge branch 'main' of github.com:BlackSamorez/transformers
5a68cd6e
BlackSamorez minor edits
1cb9f0c1
BlackSamorez updated flute cuda version in docker
257c39b0
BlackSamorez Added p=1 and 2,3bit HIGGS
f82d1a38
BlackSamorez flute version check update
b7479804
BlackSamorez incorporated `modules_to_not_convert`
398d5b18
BlackSamorez
BlackSamorez less hardcoding
0ede69c2
BlackSamorez Merge branch 'main' into main
ebe6766e
BlackSamorez
MekkCyber
MekkCyber
MekkCyber commented on 2024-12-02
BlackSamorez Fixed comment
4e730a9d
BlackSamorez Added docs
c3848f37
BlackSamorez
MekkCyber
MekkCyber commented on 2024-12-02
BlackSamorez Fixed gemma support
c91182a3
BlackSamorez example in docs
8e1da3de
BlackSamorez
MekkCyber
MekkCyber
MekkCyber commented on 2024-12-02
MekkCyber
MekkCyber approved these changes on 2024-12-02
BlackSamorez
BlackSamorez fixed torch_dtype for HIGGS
15f37898
MekkCyber MekkCyber requested a review from SunMarc SunMarc 1 year ago
BlackSamorez
SunMarc
BlackSamorez
SunMarc
SunMarc approved these changes on 2024-12-05
SunMarc SunMarc requested a review from ArthurZucker ArthurZucker 1 year ago
BlackSamorez Update docs/source/en/quantization/higgs.md
b10375f2
BlackSamorez Collection link
2abdc849
BlackSamorez
SunMarc
BlackSamorez dequantize interface
5074b608
BlackSamorez newer flute version, torch.compile support
2fab798c
BlackSamorez unittest message fix
db27c598
SunMarc
SunMarc
SunMarc approved these changes on 2024-12-13
ArthurZucker
ArthurZucker approved these changes on 2024-12-17
huggingface huggingface deleted a comment from code30x58 on 2024-12-18
BlackSamorez docs update compile
6917eceb
BlackSamorez Merge branch 'main' into main
7c003c28
BlackSamorez isort
e317fc5a
BlackSamorez
BlackSamorez ValueError instead of assert
53e6827f
SunMarc
SunMarc approved these changes on 2024-12-23
HuggingFaceDocBuilderDev
BlackSamorez
SunMarc
SunMarc SunMarc merged 64c05eec into main 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum