auto-round
Support for immediate saving to reduce ram usage
#965
Merged
Overview
Commits
38
Changes
View On GitHub
Commits
  • save per block
    Kaihui-intel committed 290 days ago
  • enable multi block save
    Kaihui-intel committed 282 days ago
  • support export save
    Kaihui-intel committed 277 days ago
  • update rtn support
    Kaihui-intel committed 276 days ago
  • support
    Kaihui-intel committed 276 days ago
  • rebase main
    Kaihui-intel committed 276 days ago
  • del utils.py
    Kaihui-intel committed 276 days ago
  • [pre-commit.ci] auto fixes from pre-commit.com hooks
    pre-commit-ci[bot] committed 276 days ago
  • fix args
    Kaihui-intel committed 276 days ago
  • optimize memory and fix rtn module
    Kaihui-intel committed 275 days ago
  • revert max_shard_size
    Kaihui-intel committed 275 days ago
  • move save_block_immediate into utils
    Kaihui-intel committed 275 days ago
  • [pre-commit.ci] auto fixes from pre-commit.com hooks
    pre-commit-ci[bot] committed 275 days ago
  • [pre-commit.ci] auto fixes from pre-commit.com hooks
    pre-commit-ci[bot] committed 275 days ago
  • fix import
    Kaihui-intel committed 275 days ago
  • update max_shard_size
    Kaihui-intel committed 275 days ago
  • Merge branch 'kaihui/save_block' of https://github.com/intel/auto-round into kaihui/save_block
    Kaihui-intel committed 275 days ago
  • remove is_meta_model
    Kaihui-intel committed 275 days ago
  • [pre-commit.ci] auto fixes from pre-commit.com hooks
    pre-commit-ci[bot] committed 275 days ago
  • merge main
    Kaihui-intel committed 275 days ago
  • add uts
    Kaihui-intel committed 275 days ago
  • [pre-commit.ci] auto fixes from pre-commit.com hooks
    pre-commit-ci[bot] committed 275 days ago
  • fix gpu ut model_name
    Kaihui-intel committed 275 days ago
  • set immediate packing saving to True
    Kaihui-intel committed 271 days ago
  • [pre-commit.ci] auto fixes from pre-commit.com hooks
    pre-commit-ci[bot] committed 271 days ago
  • Merge branch 'main' into kaihui/save_block
    Kaihui-intel committed 271 days ago
  • flow saving setting
    Kaihui-intel committed 271 days ago
  • check gguf
    Kaihui-intel committed 270 days ago
  • pack layer_names immediately
    Kaihui-intel committed 270 days ago
  • wrapper _immediate_pack & rm uts & pop lm_head & rm expose args
    Kaihui-intel committed 270 days ago
  • revert ut
    Kaihui-intel committed 270 days ago
  • [pre-commit.ci] auto fixes from pre-commit.com hooks
    pre-commit-ci[bot] committed 270 days ago
  • add low_cpu_mem_usage
    Kaihui-intel committed 269 days ago
  • merge main
    Kaihui-intel committed 269 days ago
  • [pre-commit.ci] auto fixes from pre-commit.com hooks
    pre-commit-ci[bot] committed 269 days ago
  • fix conflict
    Kaihui-intel committed 269 days ago
  • update low_cpu_mem_usage
    Kaihui-intel committed 268 days ago
  • move to last arg
    Kaihui-intel committed 268 days ago
FAQ Terms Privacy Refunds Impressum
Loading