transformers
[`Flash Attention`] Fix flash attention integration
#40002
Merged
Overview
Commits
39
Changes
View On GitHub
Commits
  • fix flash attention
    vasqu committed 1 year ago
  • i got a stroke reading that comment
    vasqu committed 1 year ago
  • change dropout kwarg back to before
    vasqu committed 1 year ago
  • rename _fa3... as it's used for multiple variants and should work as fallback instead
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • simplify imports and support kwargs for fa
    vasqu committed 1 year ago
  • style
    vasqu committed 1 year ago
  • fix comments order
    vasqu committed 1 year ago
  • small fix
    vasqu committed 1 year ago
  • skip kernels test (causes cuda illegal memories w/o cleanup), fix fa test in general esp for models like bart
    vasqu committed 1 year ago
  • style
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • allow fullgraph by preloading on init
    vasqu committed 1 year ago
  • make globals "private"
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • ci pls be happy
    vasqu committed 1 year ago
  • change skip conditions based on backend flag (indicating missing mask interface)
    vasqu committed 1 year ago
  • move globals support to a function to prepare kwargs
    vasqu committed 1 year ago
  • style
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • generalize supported kwargs
    vasqu committed 1 year ago
  • small change to doc
    vasqu committed 1 year ago
  • fix
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • add comments
    vasqu committed 1 year ago
  • style
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • revert prep during generate
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • style
    vasqu committed 1 year ago
  • revert weird style changes
    vasqu committed 1 year ago
  • add fa kwarg prep during generate with fixes back
    vasqu committed 1 year ago
  • how did this even happen
    vasqu committed 1 year ago
  • how
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
  • add comment
    vasqu committed 1 year ago
  • Merge branch 'main' into fix-fa-integration
    vasqu committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading