Do not update past_key_values in place #652
irenedea
merged
18 commits into
mosaicml:main
from
irenedea:fix-mpt
Add test that reproduces the attn bias broadcast error
fcc271f4
Use presents, they are a gift. Do not update past_key_values in place.
655fc75a
Ensure that the other ranks do not hit EOS
e758d7d1
Uncomment the other tests
56b82ccb
irenedea
commented
on 2023-10-07
Merge branch 'main' into fix-mpt
34b75e55
Fix code quality
2ae1c947
Merge branch 'main' into fix-mpt
f8b36060
Merge branch 'main' into fix-mpt
edcab180
dakinggg
approved these changes
on 2023-10-09
Merge branch 'main' into fix-mpt
a542a9c4
Merge branch 'main' into fix-mpt
f5638989
Merge branch 'main' into fix-mpt
319862b8
vchiley
approved these changes
on 2023-10-10
Change test to use mpt directly
99ed8720
simplify
11b86e4b
Use alibi
e4335304
Merge branch 'main' into fix-mpt
8207dbd3
Fix code quality
61c8b0d1
attn_uses_sequence_id set to false
3951de13
dakinggg
commented
on 2023-10-12
dakinggg
approved these changes
on 2023-10-12
Add model.eval()
27f1a001
Login to write a write a comment.
Login via GitHub