PR #2649 tweaks to ds-attn, distilbert policy, and mup

tweaks to ds-attn, distilbert policy, and mup #2649

jeffra merged 3 commits into master from jeffra/ds-attn-tweaks

tweaks to ds-attn, distilbert policy, mup, etc.

d0d28bb5

jeffra requested a review from

RezaYazdaniAminabadi 2 years ago

jeffra requested a review from

mrwyattii 2 years ago

jeffra requested a review from

awan-10 2 years ago

jeffra requested a review from

cmikeh2 2 years ago

jeffra requested a review from

arashb 2 years ago

jeffra changed the title ~~tweaks to ds-attn, distilbert policy, mup, etc.~~ tweaks to ds-attn, distilbert policy, and mup 2 years ago

fixes for distilbert

c49b10cd

adjust kwargs to match position args for bert (hack)

da81b59e

cmikeh2 approved these changes on 2022-12-28

jeffra merged d9b788d7 into master 2 years ago

jeffra deleted the jeffra/ds-attn-tweaks branch 2 years ago

Reviewers

cmikeh2

mrwyattii

awan-10

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone