llama.cpp
ee1d670c - parallel : fix bug (extra BOS) + smaller token_prev array

Commit

1 year ago

parallel : fix bug (extra BOS) + smaller token_prev array

References

#3228 - llama : custom attention mask + parallel decoding + no context swaps

Author

ggerganov

ggerganov

Parents

Loading