auto-round
[STEP-1]W4Afp8 export
#378
Merged

[STEP-1]W4Afp8 export #378

wenhuach21 merged 49 commits into main from fp8_export
wenhuach21
wenhuach21 w4fp8 export
310cf213
wenhuach21 wenhuach21 changed the title w4fp8 export W4Afp8 export 1 year ago
wenhuach21 wenhuach21 marked this pull request as draft 1 year ago
wenhuach21 fix some issues
5b29135d
wenhuach21 support gptq exporting
8dddf80f
Yi4Liu use bf16 and disable some imports
88ec7f41
wenhuach21 export two scales
e9df1217
Yi4Liu copy val instead of assign
80fb3f8d
wenhuach21 fixed a critic bug
4b3ea1b5
wenhuach21 fix
23f569f9
Yi4Liu add backoff
9f281d72
wenhuach21 tiny change
40eec400
wenhuach21 add config
f899cbf0
Yi4Liu clean code
2e27ca33
Yi4Liu add v2
14a59a2b
Yi4Liu add pc
997a43b7
Yi4Liu tune bf16 to fp8 scale
14203d64
wenhuach21 Merge branch 'fp8_export' of https://github.com/intel/auto-round into…
26919e29
Yi4Liu clean code
d752280d
yiliu30 clean code
76009f2f
yiliu30 revert unrelated change
b4f5acae
yiliu30 remove global_config
80bd1678
yiliu30 rm global_config
c39fa40f
yiliu30 refine llm script
0a795d98
yiliu30 refine llm script
4fa68013
yiliu30 remove empty line
3bc3b22c
yiliu30 add UT
54e5b575
yiliu30 merge with main
eef8d290
yiliu30 yiliu30 marked this pull request as ready for review 1 year ago
wenhuach21
wenhuach21 commented on 2025-01-23
wenhuach21
wenhuach21 commented on 2025-01-23
wenhuach21
wenhuach21 commented on 2025-01-23
wenhuach21
wenhuach21 commented on 2025-01-23
wenhuach21
wenhuach21 wenhuach21 closed this 1 year ago
wenhuach21 wenhuach21 reopened this 1 year ago
wenhuach21 Merge branch 'main' into fp8_export
933373c8
wenhuach21 wenhuach21 marked this pull request as draft 361 days ago
wenhuach21 fix conflict
6d85f4e8
wenhuach21 revert some changes
e6762ebd
wenhuach21 revert some change
4aeb35a4
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
b2a8a45e
wenhuach21 refine the code
f29ad252
wenhuach21 Merge branch 'fp8_export' of https://github.com/intel/auto-round into…
2a9b519d
wenhuach21 Merge branch 'main' into fp8_export
2f25afdc
wenhuach21 tmp change
ef2bc545
wenhuach21 Merge branch 'main' into fp8_export
bb1e34b7
wenhuach21 Merge branch 'main' into fp8_export
81d59a2b
wenhuach21 refine the code
d740165c
wenhuach21 wenhuach21 marked this pull request as ready for review 354 days ago
wenhuach21 wenhuach21 requested a review from yiliu30 yiliu30 354 days ago
wenhuach21 clean code
6c1f441f
wenhuach21 try to fix preci issue
aae78f50
wenhuach21 tiny change
2c0d0589
wenhuach21 comment hpu test, will fix it later
b2dec969
wenhuach21 fix ut
625f39d6
wenhuach21 fix preci
6ff20900
wenhuach21 revert incorrect changes
bc7936fc
wenhuach21 revert incorrect changes
cca8e60d
wenhuach21 Merge branch 'main' into fp8_export
90f9e5f4
wenhuach21 force to bf16 if activation quantization is enabled
cf59271e
wenhuach21 Merge branch 'fp8_export' of https://github.com/intel/auto-round into…
bb26ed58
wenhuach21 wenhuach21 requested a review from WeiweiZhang1 WeiweiZhang1 353 days ago
wenhuach21 wenhuach21 requested a review from n1ck-guo n1ck-guo 353 days ago
yiliu30
yiliu30 approved these changes on 2025-03-11
wenhuach21 wenhuach21 changed the title W4Afp8 export [STEP-1]W4Afp8 export 353 days ago
wenhuach21 wenhuach21 merged 7f6e5d40 into main 353 days ago
wenhuach21 wenhuach21 deleted the fp8_export branch 353 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone