PR #599 Allow MPT models to return attention weights

Allow MPT models to return attention weights #599

dakinggg merged 15 commits into mosaicml:main from lorabit110:main

Allow MPT models to return attention weights

a4f56790

dakinggg commented on 2023-09-15

dakinggg requested a review from

vchiley 2 years ago

dakinggg commented on 2023-09-15

Update llmfoundry/models/mpt/modeling_mpt.py

89f8e83f

Add unit test

655cee4f

Merge branch 'main' of github.com:lorabit110/llm-foundry

c655217a

Merge branch 'main' into main

950ef428

dakinggg approved these changes on 2023-09-15

Update tests/test_model.py

2fad7a51

dakinggg enabled auto-merge (squash) 2 years ago

disabled auto-merge 2 years ago
Manually disabled by user

Merge branch 'main' into main

3c2a9756

dakinggg commented on 2023-09-16

Update tests/test_model.py

2846d29a

dakinggg enabled auto-merge (squash) 2 years ago

retrigger checks

f4e4f49c

Merge branch 'main' of github.com:lorabit110/llm-foundry

f00f8eaa

Merge branch 'main' into main

d5bc46b5

Merge branch 'main' into main

7d6639f1

Merge branch 'main' into main

32334e09

dakinggg commented on 2023-09-21

Update tests/test_model.py

507b4df1

Merge branch 'main' into main

98531350

dakinggg merged 0be2ca82 into main 2 years ago

Reviewers

dakinggg

vchiley

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

llm-foundry Allow MPT models to return attention weights #599 Merged

Allow MPT models to return attention weights #599

llm-foundry
Allow MPT models to return attention weights
#599

Merged