onnxruntime
Added a tool to quantize Gather to GatherBlockQuantized
#21697

Merged

Added a tool to quantize Gather to GatherBlockQuantized #21697

fajin-corp merged 19 commits into main from fajin/gatherblockquantizetool

github-advanced-security commented on 2024-08-10

fajin-corp requested a review from

yufenglee 2 years ago

yufenglee commented on 2024-08-14

updated interface to add quantize ops argument

154785ee

updated quantize op to be set

d26d329b

added per op quant axis argument

7af17419

added quantize gather framework

7f4d545f

not supporting hqq

37be006a

finished tool code

e11ff161

added ut

8ddd272f

update quantize.py

ec838aed

fixing ut

d169ccd2

fix linting

a141af44

fix type hinting

aa190625

fix union in ut

41f3537e

fix type hinting in ut

7e63c4c5

fix training package import error

cc467cd7

fix linting

68622888

add nodes to include

95a712fa

fajin-corp force pushed from d54a2e2b to 95a712fa 2 years ago

fix ut

8379d684

yufenglee commented on 2024-08-16

change quantize predicate order

2a536e07

yufenglee dismissed these changes on 2024-08-16

fix linting

457321d3

fajin-corp dismissed their stale review via 457321d3 2 years ago

yufenglee approved these changes on 2024-08-17

fajin-corp merged 64674c50 into main 2 years ago

fajin-corp deleted the fajin/gatherblockquantizetool branch 2 years ago

Reviewers

yufenglee

github-advanced-security

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

onnxruntime Added a tool to quantize Gather to GatherBlockQuantized #21697 Merged

Added a tool to quantize Gather to GatherBlockQuantized #21697

onnxruntime
Added a tool to quantize Gather to GatherBlockQuantized
#21697

Merged