intel/auto-round

Pull Requests Commits

Refactor shard parallelism handling and update documentation for clarity

xin3he committed 10 hours ago

798c40d0

Merge branch 'main' into xinhe/6-23

xin3he committed 14 hours ago

Verified cd922ebc

Implement shard processing with multiprocessing for improved performance

xin3he committed 15 hours ago

45d37870

fix issue of step3p7 and CI failure (#1929)

xin3he committed 17 hours ago

Verified 1c4baa03

Update PyTorch and torchvision versions to 2.12.1 and 0.27.1 in CI (#1943)

XuehaoSun committed 17 hours ago

Verified 354c6a3b

Update CPU agent pool (#1936)

chensuyue committed 18 hours ago

Verified 35650a09

xin3he committed 19 hours ago

5f5e8ee4

Implement shard parallelism configuration and update documentation

xin3he committed 19 hours ago

029509a1

Fix SIGSEGV in pack-weight unpack/GEMM on malformed blob (#1928)

luoyu-intel committed 1 day ago

Verified 495e2539

Refine AutoScheme logic for gguf, reduce memory consumption and improve speed (#1916)

wenhuach21 committed 1 day ago

Verified 0c9c5b1d

DDP for multiple cards (#1897)

yiliu30 committed 3 days ago

Verified 33b7df0e

reorder UT for CUDA CI memory leak (#1938)

xin3he committed 5 days ago

Verified 0cc47c69

update what's new: vllm-omni integrates AutoROund (#1931)

xin3he committed 5 days ago

Verified 759a9ad7

Enhance b70 check (#1937)

yiliu30 committed 5 days ago

Verified e8709167

Support Wan2.2 S2V Quantization (#1924)

changwangss committed 5 days ago

Verified ca378799

Fix UT coverage (#1927)

XuehaoSun committed 5 days ago

Verified 6b311875

[Model Free] Add MXFP mix-precision quantization and support RoutedExperts (#1921)

xin3he committed 6 days ago

Verified be043f32

refactor and support for multi algs fusion (#1920)

n1ck-guo committed 6 days ago

Verified df9299da

enable MXFP clamp for model free (#1914)

xin3he committed 11 days ago

Verified 50ee58c9

fix awq cuda CI (#1912)

WeiweiZhang1 committed 12 days ago

Verified 34790de7

fix inplace rotation issue (#1903)

wenhuach21 committed 12 days ago

Verified 9d5edd56

[ARK] update README (#1906)

luoyu-intel committed 12 days ago

Verified c014b0eb

fallback compute type on b70 if needed (#1904)

yiliu30 committed 12 days ago

Verified 0c845c3d

fix: guard zero-division in GGUF quant kernels to avoid NaN block scales (#1909)

Entrpi committed 12 days ago

Verified 4a60b6fe

fix gguf opt-rtn regression (#1905)

wenhuach21 committed 13 days ago

Verified dc5e67f3

update llama-cpp-python installation for CUDA CI (#1907)

XuehaoSun committed 13 days ago

Verified 786cc78e

feat: improve review-pr skill score from 76% to 90% (#1901)

yogesh-tessl committed 13 days ago

Verified 26e2f3a9

Fix slow startup time of pytest coverage for unit tests (#1899)

XuehaoSun committed 14 days ago

Verified b58f934a

feat: add MXFP4/MXFP8 quantization support (llmc_compressor format) and related tests (#1865)

xin3he committed 14 days ago

Verified dc5216c8

Fix CI coverage & bug grep issue (#1893)

chensuyue committed 14 days ago

Verified a2fbad79

Older