Disable flash attention for Gemma2 - SemanticDiff

Commit

2 years ago

Disable flash attention for Gemma2

References

#8197 - Add attention and final logit soft-capping, update scaling factor to Gemma2

Author

abetlen

abetlen

Parents

Loading