Paligemma causal attention mask #30967
molbap
merged
31 commits into
main
from
paligemma-causal-attention-mask
PaliGemma working causal attention
9ae0773e
Formatting
0424fd68
Style
7c7b43b6
Docstrings + remove commented code
ca5dcb5a
Update docstring for PaliGemma Config
28ac09c4
PaliGemma - add separator ind to model/labels
52ba9adf
Refactor + docstring paligemma processor method
9a732f42
Style
91d6499c
return token type ids when tokenizing labels
aeaf8621
use token type ids when building causal mask
41fe49f1
add token type ids to tester
047510cd
remove separator from config
97aac21e
fix style
25df1d6a
Merge branch 'main' into paligemma-causal-attention-mask
ff93a2df
don't ignore separator
4430ade4
add processor documentation
0c204482
simplify tokenization
843a8def
Merge branch 'main' into paligemma-causal-attention-mask
fc94bae4
fix causal mask
6cfc20a0
style
4c1295eb
probicheaux
commented
on 2024-05-22
ArthurZucker
commented
on 2024-05-22
probicheaux
commented
on 2024-05-22
fix label propagation, revert suffix naming
06353bd7
fix style
1d03480a
probicheaux
commented
on 2024-05-22
fix labels tokenization
26ac6677
[run-slow]paligemma
b08b8156
add eos if suffixes are present
e6875a64
[run-slow]paligemma
9ab47e0d
[run-slow]paligemma
676b2df2
add misssing tokens to fast version
97794a6d
Apply suggestions from code review
d041264b
fix style
e6c724de
[run-slow]paligemma
9b00e256
Login to write a write a comment.
Login via GitHub