intel/auto-round

Pull Requests Commits

mengniwang95 committed 361 days ago

b7f1ee0c

mengniwang95 committed 362 days ago

e42583d0

support llama4 quant

mengniwang95 committed 1 year ago

cffeb163

Enable mxfp exporting (#649)

WeiweiZhang1 committed 1 year ago

Verified 64b8afee

fix gguf mistral_common import (#736)

n1ck-guo committed 1 year ago

Verified 92d31fa2

Fix torch_zp infer bug & API disable_deterministic_algorithms bug (#733)

WeiweiZhang1 committed 1 year ago

Verified 71dab1dc

fix bug for exporting afp8 fake format (#731)

n1ck-guo committed 1 year ago

Verified 978cac11

add original convert file and support for the newest llama.cpp (#729)

n1ck-guo committed 1 year ago

Verified 2acf7864

make the tuning deterministic and move infrequently used arguments to kwargs (#726)

wenhuach21 committed 1 year ago

Verified 478aedbf

new cast_to_nvfp4 with high performance (#727)

xin3he committed 1 year ago

Verified de2b48a6

update gguf convert.py and support for gpt-oss (#721)

n1ck-guo committed 1 year ago

Verified 73ecd7f8

fix fp8 model input issue (#724)

wenhuach21 committed 1 year ago

Verified 9113fa8e

Fix hpu CI (#723)

XuehaoSun committed 1 year ago

Verified 173b0921

update autoround mllm and support Mistral 3.2 series (#713)

n1ck-guo committed 1 year ago

Verified 2e911b76

Freeze torchvision version in CI (#720)

XuehaoSun committed 1 year ago

Verified 4b9fbed3

Bump transformers in /test/test_cuda (#719)

dependabot[bot] committed 1 year ago

Verified 80a09172

fix bug of activation quant when act_max is None (#718)

n1ck-guo committed 1 year ago

Verified 04d053b8

Update step_by_step.md (#717)

wenhuach21 committed 1 year ago

Verified e23cbf4a

simply CpuInfo class (#715)

wenhuach21 committed 1 year ago

Verified c731b65c

change act_scale to input_scale for fp8 export (#711)

n1ck-guo committed 1 year ago

Verified 61f0d828

support fp8 model and str as input in llm quantization (#699)

wenhuach21 committed 1 year ago

Verified 32777f73

fix critic bug of gguf tuning (#710)

wenhuach21 committed 1 year ago

Verified d945afaa

code optimization of vlm (#704)

n1ck-guo committed 1 year ago

Verified ef4af0f0

catch oom error and move to cpu directly (#708)

n1ck-guo committed 1 year ago

Verified 31850105

fix bug of zero accuracy for mx-fp (#709)

n1ck-guo committed 1 year ago

Verified 34051b3d

FIXBUG: CPU Offloading for Cache Blocks in Low-Memory GPU Systems or Single GPU on ROCM Configs (#703)

JartX committed 1 year ago

Verified 61800412

fix xpu oom checker (#705)

n1ck-guo committed 1 year ago

Verified 32d2cd51

support for static activation quantization calibration with group_size (#693)

n1ck-guo committed 1 year ago

Verified 6afe07cb

support to save image_processor (#694)

n1ck-guo committed 1 year ago

Verified 4079a810

Add script for cuda unit test (#567)

XuehaoSun committed 1 year ago

Verified 4e617551

Older