accelerate
Add warnings and fallback for unassigned devices in infer_auto_device_map
#3066
Merged
Merged
Add warnings and fallback for unassigned devices in infer_auto_device_map #3066
muellerzr
merged
15 commits into
huggingface:main
from
Nech-C:auto-infer-warnings-and-fallback
feat: feat: Add warning for unassigned main devices
480d4416
BenjaminBossan
commented
on 2024-09-02
refactor: Improve warning for unassigned main devices
4f89c263
BenjaminBossan
commented
on 2024-09-03
feat: impl fallback_allocate; fix output format
aefd770f
fix: include last dot index in the iteration
dc6641c5
feat: incorporate fallback allocation into infer_auto_device_map
d607bfb5
Revert "feat: incorporate fallback allocation into infer_auto_device_…
f0403027
refactor: add helper functions and eliminate redundant variables
9db401e7
refactor: simplify allocation logic by removing duplicates and reduci…
0b52bdcf
feat: incorporate fallback allocation into infer_auto_device_map
7ff9f267
fix: fix module splitting logic
be385b08
styles: fix styling errors
c6025ee9
test: add test coverage for no-warning cases
a35776cc
refactor: simplify control flow in infer_auto_device_map
73dbc768
BenjaminBossan
approved these changes
on 2024-10-15
muellerzr
approved these changes
on 2024-10-15
SunMarc
commented
on 2024-10-15
SunMarc
approved these changes
on 2024-11-05
refactor: replace warnings.warn with logger.info for allocation failures
5a72010d
SunMarc
approved these changes
on 2024-11-18
fix: use assertLogs to capture no allocation warning messages correctly
c25383a6
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub