transformers
:rotating_light: [`FA4`] Initial support
#42435
Merged
Overview
Commits
42
Changes
View On GitHub
Commits
  • initial implementation
    vasqu committed 269 days ago
  • Merge branch 'main' into fa4-support
    vasqu committed 268 days ago
  • CB support
    vasqu committed 268 days ago
  • change how we call item on max_seq_len_q/k
    vasqu committed 268 days ago
  • fix
    vasqu committed 268 days ago
  • tests
    vasqu committed 268 days ago
  • fix fa2 clash
    vasqu committed 268 days ago
  • unify the fa dispatch
    vasqu committed 268 days ago
  • fix
    vasqu committed 268 days ago
  • modernbert...
    vasqu committed 268 days ago
  • oops
    vasqu committed 268 days ago
  • parity test
    vasqu committed 267 days ago
  • style
    vasqu committed 267 days ago
  • nit
    vasqu committed 267 days ago
  • Merge branch 'main' into fa4-support
    vasqu committed 169 days ago
  • fixup imports for fa4
    vasqu committed 169 days ago
  • enable attention sinks, fixup logits checks in parity test
    vasqu committed 169 days ago
  • Merge branch 'main' into fa4-support
    vasqu committed 169 days ago
  • style
    vasqu committed 169 days ago
  • change dispatch logic and introduce lower bound for FA
    vasqu committed 166 days ago
  • Merge branch 'main' into fa4-support
    vasqu committed 166 days ago
  • style
    vasqu committed 166 days ago
  • fix test
    vasqu committed 166 days ago
  • min fa2, avoid 2x device sync
    vasqu committed 166 days ago
  • Merge branch 'main' into fa4-support
    vasqu committed 166 days ago
  • style
    vasqu committed 166 days ago
  • simple min version instead of list
    vasqu committed 165 days ago
  • fixup error message on non init check
    vasqu committed 165 days ago
  • fixup up non init check a tad more
    vasqu committed 165 days ago
  • Merge branch 'main' into fa4-support
    vasqu committed 162 days ago
  • refactor some FA constants out to main fa utils
    vasqu committed 162 days ago
  • new marker for all fas needed
    vasqu committed 162 days ago
  • oops
    vasqu committed 162 days ago
  • style and make the fa kernel fallback generalized
    vasqu committed 162 days ago
  • default none...
    vasqu committed 162 days ago
  • more refactors
    vasqu committed 162 days ago
  • style
    vasqu committed 162 days ago
  • fix
    vasqu committed 162 days ago
  • this test faulty even on main, xformers can handle any shape apparently yikes
    vasqu committed 162 days ago
  • lets make this more robust, we should check for none within...
    vasqu committed 162 days ago
  • fix
    vasqu committed 162 days ago
  • oops
    vasqu committed 162 days ago
FAQ Terms Privacy Refunds Impressum
Loading