Bigscience176b jz #1
younesbelkada
wants to merge
50 commits into
bigscience176b
from
bigscience176b-jz
small commit
7a284299
first test
50ccdaa1
fix minor issues
ef48867f
minor changes
e3748170
minor fix
ebe52d6c
try smaller model
5baecdae
rm break statement
56a23752
adding new file
682fd3e0
add new file
a0be1eb8
do not load tokenizer
5b1ce6b1
fix device map
9ab38cd2
fix input issue
7418753e
fix logits issue
72e4ca12
new modifs
d495ba99
add print shape
e100f24a
test without att mask
61273fc9
add correct att mask
5ff05870
fix torch.tensor
332e9a4e
add new logits
0ec9f0c6
add few prints
cef597c6
correct print
a254d548
fix print
85351989
add print w&b
d990860b
add .item() to print
cf3f67eb
add some prints
b0edc918
add argmax
295beb21
add new prints
830eb307
put f.linear instead
e5f5e186
remove dropout
d7bcc7b4
add scaled softmax
3687252f
add new arg in config
0b3f4d57
fix import issue
f6339d1e
fix arg issue
9d312d20
fix bias issue
79fe5db3
print shape weight
9e0014cf
print input shape
e15c9c13
add mean bias
a9768dd2
check on bias
292b96ba
add some prints
20acdaa5
change config
89c03c69
add way more prints
fe6de750
add new prints
84565e6e
add if statement
f95e1c57
add scale softmax
73218312
save logits
0c3d92b0
final changes
dfd3b845
add apex func
d508f508
add new tensors
c795adad
add .to(dtype)
eede2a3b
add message
37f869b0
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub