llm-foundry
Precompute flash attention padding info
#880
Merged
Overview
Commits
45
Changes
View On GitHub

Precompute flash attention padding info #880

ShashankMosaicML merged 45 commits into mosaicml:main from ShashankMosaicML:shashank/update_flash_attn_cache_unpad_input
ShashankMosaicML
ShashankMosaicML Merge pull request #1 from mosaicml/main
04dd3349
ShashankMosaicML Merge pull request #8 from mosaicml/main
87b2fdcd
ShashankMosaicML Merge pull request #12 from mosaicml/main
c9a42e47
ShashankMosaicML Merge branch 'mosaicml:main' into main
ddea9eec
ShashankMosaicML Merge pull request #13 from mosaicml/main
0bcd8eee
ShashankMosaicML Merge pull request #14 from mosaicml/main
f209b581
ShashankMosaicML Merge pull request #15 from mosaicml/main
ec4378df
ShashankMosaicML Merge branch 'mosaicml:main' into main
b4367063
ShashankMosaicML ..
bcace036
ShashankMosaicML Merge branch 'mosaicml:main' into main
cf4aa585
ShashankMosaicML Merge branch 'mosaicml:main' into main
7c35ce89
ShashankMosaicML ..
0a8ebfbc
ShashankMosaicML ..
6f18a332
ShashankMosaicML Merge branch 'mosaicml:main' into main
f42d5859
ShashankMosaicML Merge branch 'mosaicml:main' into main
2f3f53c1
ShashankMosaicML ..
77b975f5
ShashankMosaicML Merge branch 'mosaicml:main' into main
e28cfbea
ShashankMosaicML Merge branch 'mosaicml:main' into main
800c6f87
ShashankMosaicML Merge branch 'mosaicml:main' into main
922ef136
ShashankMosaicML Merge branch 'mosaicml:main' into main
d36f5f79
ShashankMosaicML Merge branch 'mosaicml:main' into main
d5245316
ShashankMosaicML ..
2b2f3d84
ShashankMosaicML ..
e98a01d3
ShashankMosaicML ShashankMosaicML requested a review from vchiley vchiley 2 years ago
ShashankMosaicML ShashankMosaicML requested a review from mvpatel2000 mvpatel2000 2 years ago
ShashankMosaicML ShashankMosaicML changed the title Precompute flash attention padding info WIP: Precompute flash attention padding info 2 years ago
ShashankMosaicML ..
5a9e1e88
ShashankMosaicML ..
61d8ade7
ShashankMosaicML ..
e2363059
ShashankMosaicML ..
416525ad
ShashankMosaicML ..
77597a10
ShashankMosaicML ..
09d9bdff
ShashankMosaicML ..
0474e059
ShashankMosaicML ..
0f950566
vchiley vchiley requested a review from dakinggg dakinggg 2 years ago
ShashankMosaicML ..
5063149b
ShashankMosaicML ..
0f25b731
ShashankMosaicML ..
c3d30f95
ShashankMosaicML ..
34e4a99c
ShashankMosaicML ..
03113a9c
ShashankMosaicML ShashankMosaicML marked this pull request as ready for review 2 years ago
ShashankMosaicML ShashankMosaicML requested a review from irenedea irenedea 2 years ago
ShashankMosaicML ShashankMosaicML changed the title WIP: Precompute flash attention padding info Precompute flash attention padding info 2 years ago
ShashankMosaicML ..
3351d23e
vchiley
vchiley commented on 2024-01-17
ShashankMosaicML Update llmfoundry/models/mpt/modeling_mpt.py
3d8cda89
ShashankMosaicML dummy data
b227bcf2
vchiley
vchiley approved these changes on 2024-01-17
ShashankMosaicML undoing last commit
bd28b43e
ShashankMosaicML ..
d844c5fd
vchiley
vchiley commented on 2024-01-17
ShashankMosaicML ..
293dde23
ShashankMosaicML Update llmfoundry/models/mpt/modeling_mpt.py
18bf7ca7
mvpatel2000
mvpatel2000 approved these changes on 2024-01-18
mvpatel2000
mvpatel2000 commented on 2024-01-18
dakinggg
dakinggg approved these changes on 2024-01-17
ShashankMosaicML ..
11d3d706
ShashankMosaicML ..
00bc72b4
ShashankMosaicML ShashankMosaicML merged 6dcc0d84 into main 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum