llama.cpp
80626503 - llama : fix simple splits when the batch contains embeddings

Commit

334 days ago

llama : fix simple splits when the batch contains embeddings

References

compilade/batch-splits

#8526 - llama : simplify Mamba with advanced batch splits

Author

compilade

compilade

Parents

Files1

src
- llama.cpp

Loading