llama.cpp
3d032ece - server : add `n_discard` parameter (#6300)

Commit

1 year ago

server : add `n_discard` parameter (#6300)

References

#6300 - server : add `n_discard` parameter to specify the number of tokens to discard when context is shifted

Author

kaetemi

kaetemi

Parents

Loading