Hotswap allow different alpha scalings and ranks #2177
BenjaminBossan
merged
29 commits into
huggingface:main
from
BenjaminBossan:hotswap-allow-different-alpha-scalings
[WIP] Allow different alphas for hotswapping
355e2ab2
Only enable hotswap tests in CI for now
135dfdab
More debugging
9b7d9791
Merge branch 'main' into hotswap-allow-different-alpha-scalings
3a6d4b53
More debugging
088a9d96
Take alpha from new config
3da33bac
Remove some debug code
0bba669b
Merge branch 'main' into hotswap-allow-different-alpha-scalings
c73dafc1
Compiled hotswapping works w/ different scalings
552ecac9
[WIP] Hotswap with different ranks
2dcd6a1f
Make hotswapping with different ranks work
620d43eb
More tests, docs, fixes
efaf2b03
Make style, fix
25d7a77b
BenjaminBossan
changed the title
Merge branch 'main' into hotswap-allow-different-alpha-scalings
88bd8144
Remove obsolete test
2a29370d
Merge branch 'main' into hotswap-allow-different-alpha-scalings
9b132ec5
Disable test skips for CI (only testing)
ddf1badc
Clean up, documentation
3251c6c3
Reviewer feedback: Refactor _pad_lora_weights
9966c10d
Reviewer feedback: Add clarifying comments
01924ad4
BenjaminBossan
commented
on 2025-01-30
Fix issue with bias term
66b987ef
Clarify docstring
d32d23fc
BenjaminBossan
commented
on 2025-01-31
githubnemo
approved these changes
on 2025-02-03
Reviewer feedback:
8b7e6029
BenjaminBossan
commented
on 2025-02-03
sayakpaul
approved these changes
on 2025-02-04
Reviewer feedback: add clarifying comments
d0a1fc51
BenjaminBossan
commented
on 2025-02-04
sayakpaul
approved these changes
on 2025-02-04
Reviewer feedback: address model.compile()
7772e2eb
Revert testing
fe19da53
githubnemo
approved these changes
on 2025-02-04
Simplify tests for recompilation
5bc0dbe8
Reviewer feedback: Better handling of torch cache
a412f7a7
Change fixture to clean up dynamo cache after test
0943519c
Login to write a write a comment.
Login via GitHub