llama.cpp
afc4a7de - llama : enable flash attn automatically when supported

Commit

1 year ago

llama : enable flash attn automatically when supported

References

sl/auto-flash-attn

#10101 - llama : enable flash attn automatically when supported (WIP)

Author

slaren

slaren

Committer

slaren

slaren

Parents

Loading