Fix flash attention speed issue (#32028) - SemanticDiff

Commit

1 year ago

Fix flash attention speed issue (#32028) Add the lru_cache for speed

References

#32028 - Fix flash attention speed issue

Author

Cyrilvallez

Cyrilvallez

Parents

Loading