llama.cpp
16090a5d - parallel : fix sequence termination criteria

Commit

3 years ago

parallel : fix sequence termination criteria

References

#3228 - llama : custom attention mask + parallel decoding + no context swaps

Author

ggerganov

ggerganov

Parents

Loading