text-generation-inference

c4bb5264 - fix(server): decrease memory fragmentation (#557)