text-generation-inference
34bca0b8 - fix(server): Small tidy of code from recent changes (#251)

Commit

2 years ago

fix(server): Small tidy of code from recent changes (#251) remaining_decode_tokens was calculated twice in Seq2SeqLMBatch.filter()

References

Author

njhill

Parents