transformers
[gpt-neox] Add attention_bias config to support model trained without attention biases
#28126
Merged
Merged
[gpt-neox] Add attention_bias config to support model trained without attention biases #28126
ArthurZucker
merged
2 commits into
huggingface:main
from
dalgarak:gpt_neox_no_attn_biases
add attention_bias hparam for a model trained without attention biases
1aa10b65
younesbelkada
commented
on 2023-12-19
ArthurZucker
approved these changes
on 2023-12-20
fix argument documentation error
589ab059
younesbelkada
approved these changes
on 2023-12-20
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub