DeepSpeed
c7f58c89 - Add attribute check to support git-base autotp (#6688)

Comment changes are shownComment changes are hidden
Commit
223 days ago
Add attribute check to support git-base autotp (#6688) Git-base model is an image-text model. After supporting the llama3.2 vision model, we set num_kv_heads dynamically. Git-base only includes vision_config, so we need to add an attribute check for vision_config/text_config when setting num_kv_heads. Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>
Author
Parents
  • deepspeed/module_inject
    • File
      replace_module.py