transformers
[DeepSeekV2] Fix integration tests OOM: use device_map=auto instead of 8-bit quantization
#47991
Merged
Merged
[DeepSeekV2] Fix integration tests OOM: use device_map=auto instead of 8-bit quantization #47991
ydshieh
merged
4 commits into
main
from
fix_deepseek_v2_oom
[DeepSeekV2] Fix integration tests: use device_map=auto, remove 8-bit…
6c8a0c1f
[DeepSeekV2] Update expected values for device_map=auto bfloat16 loading
85583b2e
[DeepSeekV2] Fix curly apostrophe in batch_fa2 expected text, add tea…
4b37e451
[DeepSeekV2] Round expected logit values to 4 decimal places
e8a32a53
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub