text-generation-inference
Attempt for cleverer auto batch_prefill values (some simplifications).
#2808
Merged
Merged