accelerate
Introduce model memory estimator
#1876
Merged

Introduce model memory estimator #1876

muellerzr merged 34 commits into main from model-size-estimator
muellerzr
muellerzr Estimator
c371f033
muellerzr Right err
f71d604c
muellerzr Fixup tests
fe91f09a
muellerzr muellerzr requested a review from BenjaminBossan BenjaminBossan 2 years ago
muellerzr muellerzr requested a review from pacman100 pacman100 2 years ago
muellerzr muellerzr requested a review from sgugger sgugger 2 years ago
muellerzr muellerzr requested a review from SunMarc SunMarc 2 years ago
HuggingFaceDocBuilderDev
muellerzr trust remote code
7080016f
muellerzr Print output for debugging purposes
e1fadd88
muellerzr trust_remote_code
3b3e259e
sgugger
sgugger commented on 2023-08-23
BenjaminBossan
BenjaminBossan commented on 2023-08-23
muellerzr
muellerzr Address some comments
e01d333a
muellerzr change doc to req arg
6f4be35d
muellerzr
muellerzr Properly check for _no_split_modules in transformer models
19050713
muellerzr Note on transformer models
529c2ccf
sgugger
sgugger commented on 2023-08-23
muellerzr Check/handle pentabytes
36c89a18
BenjaminBossan
muellerzr Tests are passing locally again, better handle for no_split
373c9f2a
muellerzr Merge branch 'model-size-estimator' of https://www.github.com/hugging…
93603644
muellerzr Adjust setup?
7bb7a4c2
muellerzr Let's see if the cleaner version works
fa796e08
muellerzr muellerzr requested a review from sgugger sgugger 2 years ago
muellerzr muellerzr requested a review from BenjaminBossan BenjaminBossan 2 years ago
muellerzr Refactor and clean up for testing
16e7ba9d
muellerzr Specify in comments
275a2017
muellerzr Better error handling
c03e84f7
muellerzr A million tests later
e4c7151d
muellerzr More tests + err handling
284c08db
muellerzr Require hub
5765b55e
muellerzr More with remote code
0987db41
muellerzr Clean up
1db6dcc5
muellerzr Add a test for no_split
b0211904
sgugger
sgugger commented on 2023-08-23
muellerzr Apply suggestions from code review
1ce3771e
muellerzr Docstring
24d34351
muellerzr Address some comments
8cea56e4
muellerzr rm einops
e2abea0b
muellerzr Let it err out
e8f07ff9
muellerzr Adjust errs
39e1c785
muellerzr Tests
b1cf0c71
muellerzr muellerzr requested a review from sgugger sgugger 2 years ago
muellerzr Reduce test repeats
dd624b13
sgugger
sgugger approved these changes on 2023-08-24
BenjaminBossan
BenjaminBossan approved these changes on 2023-08-24
SunMarc
SunMarc approved these changes on 2023-08-24
muellerzr Clean up borders
ee449d0c
muellerzr Tip on 20%
4709df14
muellerzr muellerzr merged 409a9df0 into main 2 years ago
muellerzr muellerzr deleted the model-size-estimator branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone