[STEP-1]W4Afp8 export #378
w4fp8 export
310cf213
wenhuach21
changed the title w4fp8 export W4Afp8 export 1 year ago
wenhuach21
marked this pull request as draft 1 year ago
fix some issues
5b29135d
support gptq exporting
8dddf80f
use bf16 and disable some imports
88ec7f41
export two scales
e9df1217
copy val instead of assign
80fb3f8d
fixed a critic bug
4b3ea1b5
fix
23f569f9
add backoff
9f281d72
tiny change
40eec400
add config
f899cbf0
clean code
2e27ca33
add v2
14a59a2b
add pc
997a43b7
tune bf16 to fp8 scale
14203d64
Merge branch 'fp8_export' of https://github.com/intel/auto-round into…
26919e29
clean code
d752280d
clean code
76009f2f
revert unrelated change
b4f5acae
remove global_config
80bd1678
rm global_config
c39fa40f
refine llm script
0a795d98
refine llm script
4fa68013
remove empty line
3bc3b22c
add UT
54e5b575
merge with main
eef8d290
yiliu30
marked this pull request as ready for review 1 year ago
Merge branch 'main' into fp8_export
933373c8
wenhuach21
marked this pull request as draft 361 days ago
fix conflict
6d85f4e8
revert some changes
e6762ebd
revert some change
4aeb35a4
[pre-commit.ci] auto fixes from pre-commit.com hooks
b2a8a45e
refine the code
f29ad252
Merge branch 'fp8_export' of https://github.com/intel/auto-round into…
2a9b519d
Merge branch 'main' into fp8_export
2f25afdc
tmp change
ef2bc545
Merge branch 'main' into fp8_export
bb1e34b7
Merge branch 'main' into fp8_export
81d59a2b
refine the code
d740165c
wenhuach21
marked this pull request as ready for review 354 days ago
clean code
6c1f441f
try to fix preci issue
aae78f50
tiny change
2c0d0589
comment hpu test, will fix it later
b2dec969
fix ut
625f39d6
fix preci
6ff20900
revert incorrect changes
bc7936fc
revert incorrect changes
cca8e60d
Merge branch 'main' into fp8_export
90f9e5f4
force to bf16 if activation quantization is enabled
cf59271e
Merge branch 'fp8_export' of https://github.com/intel/auto-round into…
bb26ed58
yiliu30
approved these changes
on 2025-03-11
wenhuach21
changed the title W4Afp8 export [STEP-1]W4Afp8 export 353 days ago
wenhuach21
deleted the fp8_export branch 353 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub