llama.cpp
fa7ebcca - ggml : fix GQA support in ggml_flash_attn_ext

Commit

1 year ago

ggml : fix GQA support in ggml_flash_attn_ext

References

#5021 - ggml : add Flash Attention

Author

ggerganov

ggerganov

Parents

Loading