peft
Add Conv1D support to CoRDA for GPT-2 compatibility #2991
#2992
Merged

Commits
  • Add Conv1D support to CoRDA for GPT-2 compatibility
    sambhavnoobcoder committed 82 days ago
  • Handle Conv1D weight transpose in collect_eigens_for_layer
    sambhavnoobcoder committed 82 days ago
  • Fix Conv1D dimension checks in crop_corda_eigens
    sambhavnoobcoder committed 82 days ago
  • Fix Conv1D dimension handling in corda_init
    sambhavnoobcoder committed 82 days ago
  • Add unit test for CoRDA Conv1D support with GPT-2
    sambhavnoobcoder committed 82 days ago
  • Use transpose function for Conv1D delta normalization
    sambhavnoobcoder committed 82 days ago
  • Use tiny-random-gpt2 and random input for Conv1D test
    sambhavnoobcoder committed 82 days ago
  • Make imports global and add explanatory comments
    sambhavnoobcoder committed 82 days ago
  • issue fix
    sambhavnoobcoder committed 82 days ago
  • Use self.fan_in_fan_out instead of isinstance check for transpose
    sambhavnoobcoder committed 82 days ago
Loading