llama.cpp
734f9e29 - use common_batch_add, reuse llama_batch in loop

Commit

1 year ago

use common_batch_add, reuse llama_batch in loop

References

#9745 - llama : remove all_pos_0, all_pos_1, all_seq_id from llama_batch

Author

ngxson

ngxson

Parents

Loading