Inference V2 Human Eval #4804
lekurile
merged
48 commits into
master
from
lekurile/infv2_lm_eval
Human Eval Testing
8ecb9331
LM Eval Testing
6c2d14f0
Merge branch 'master' into lekurile/infv2_lm_eval
b21c6291
Update Human Eval script
998ab9bd
Add MII pipeline to human eval
95e7e6b2
Add initial Human Eval PyTest
e1026565
Generate and save samples in PyTest
ede0060f
Update unit test
3927df91
Update the DeepSpeed Phi-2 impl. to work with the HF latest changes
aeb27483
Merge branch 'master' into arashb/fix-phi-2
988d9a49
Merge branch 'master' into arashb/fix-phi-2
706b5c23
Update the Phi-2 weights mapping
921a34d2
add api to get remaining capacity in block
f6727e1a
add option to skip check in put()
a72f3f07
use int values for kv cache blocks instead of torch tensors
cc9ad227
fix condition to skip checking schedulability
d894f100
Merge branch 'master' into tohtana/api_remaining_capacity
e7a470d4
Merge branch 'master' into arashb/fix-phi-2
171873ec
Merge branch 'master' into lekurile/infv2_lm_eval
2882f7e4
Run Mixtral
e47b1b3a
Merge branch 'arashb/fix-phi-2' into lekurile/infv2_lm_eval
b4e87b0d
Merge branch 'tohtana/api_remaining_capacity' into lekurile/infv2_lm_…
bd673abb
Debug
8f3242d8
Clean up test
a6a3745f
Merge branch 'master' into lekurile/infv2_lm_eval
d874e2e3
Delete old scripts
3693d587
delete lm eval script
3a365fa3
Fix minor issues
59c3d6dd
Remove comment
418b601f
Add nv-human-eval workflow
65337fb5
Fix syntax
80dec381
Update sed command
4ecad53d
Merge branch 'master' into lekurile/infv2_lm_eval
d721694d
loadams
commented
on 2024-01-25
Address comments
2f308985
Merge branch 'lekurile/infv2_lm_eval' of https://github.com/microsoft…
0ab4b783
Move test to test_human_eval.py
5f9f9979
loadams
commented
on 2024-01-25
Fix formatting
1b1021a4
Normalize mark format
3e18534e
mrwyattii
commented
on 2024-01-26
Changes to GH workflow and pytest.ini
7a655818
mrwyattii
approved these changes
on 2024-01-26
Merge branch 'master' into lekurile/infv2_lm_eval
8ab38761
Merge branch 'master' into lekurile/infv2_lm_eval
fa8d9680
Merge branch 'master' into lekurile/infv2_lm_eval
a7e41053
Update human eval unit test
289d9010
Use get_accelerator().empty_cache() to clear GPU cache
33ba898d
Fix formatting and update sed command in GH workflow
15606059
Fix formatting
5567b90f
Merge branch 'master' into lekurile/infv2_lm_eval
9a44a860
Fix path in workflow sed
f3a2813e
Login to write a write a comment.
Login via GitHub