intel/auto-round

Pull Requests Commits

fix gguf bug by int zp (#771)

n1ck-guo committed 1 year ago

Verified f01e8047

fix gguf ut bug (#767)

n1ck-guo committed 1 year ago

Verified 48ab0db9

refine code and fix activation quantization eval regression (#762)

wenhuach21 committed 1 year ago

Verified 305923bc

Revert "Speedup FP4 packing (#760)" (#763)

yiliu30 committed 1 year ago

Verified ec76f612

support quant lm_head for rtn w8afp8 static quant (#754)

n1ck-guo committed 1 year ago

Verified de7ecc1b

fix_script_fp_layer_config_for_bits_checking (#756)

WeiweiZhang1 committed 1 year ago

Verified 5e406991

Speedup FP4 packing (#760)

yiliu30 committed 1 year ago

Verified 3648639e

fix some torch compile warnings (#755)

wenhuach21 committed 1 year ago

Verified 1f1d0a9c

api support for fp8 model and mllm api support load from str (#752)

n1ck-guo committed 1 year ago

Verified fcbcaa48

fix alg_ext moe and model str input bug (#751)

wenhuach21 committed 1 year ago

Verified 8f84bcb7

support deepspeed LinearLayer and LinearAllreduce (#698)

xin3he committed 1 year ago

Verified 8c2df83a

mllm supports loading fp8 model and fix bug of loading fp8 model (#750)

n1ck-guo committed 1 year ago

Verified c1e719b9

refine code (#749)

wenhuach21 committed 1 year ago

Verified e9b2b83b

Add Static FP8 KV Support (#737)

yiliu30 committed 1 year ago

Verified fe1db091

improved algorithm for int2 (#748)

wenhuach21 committed 1 year ago

Verified 64e76116

fix bug of loading fp8 model (#747)

n1ck-guo committed 1 year ago

Verified 00293227

support llama4 quant (#744)

mengniwang95 committed 1 year ago

Verified 2df63f27

fix UT check for int zp (#745)

WeiweiZhang1 committed 1 year ago

Verified 1f79db9b

Optimize pack zeros for int sym (#743)

WeiweiZhang1 committed 1 year ago

Verified 8888dda7

support auto-round-mllm command (#742)

n1ck-guo committed 1 year ago

Verified cd980c71

[WIP] support for glm4.5 gguf (#735)

n1ck-guo committed 1 year ago

Verified 4f740ccb

Enable mxfp exporting (#649)

WeiweiZhang1 committed 1 year ago

Verified 64b8afee

fix gguf mistral_common import (#736)

n1ck-guo committed 1 year ago

Verified 92d31fa2

Fix torch_zp infer bug & API disable_deterministic_algorithms bug (#733)

WeiweiZhang1 committed 1 year ago

Verified 71dab1dc

fix bug for exporting afp8 fake format (#731)

n1ck-guo committed 1 year ago

Verified 978cac11

add original convert file and support for the newest llama.cpp (#729)

n1ck-guo committed 1 year ago

Verified 2acf7864

make the tuning deterministic and move infrequently used arguments to kwargs (#726)

wenhuach21 committed 1 year ago

Verified 478aedbf

new cast_to_nvfp4 with high performance (#727)

xin3he committed 1 year ago

Verified de2b48a6

update gguf convert.py and support for gpt-oss (#721)

n1ck-guo committed 1 year ago

Verified 73ecd7f8

fix fp8 model input issue (#724)

wenhuach21 committed 1 year ago

Verified 9113fa8e

Newer Older