text-generation-inference

7c046c91 - First step towards cleaning up

First step towards cleaning up Breaks tests, but I want to shuffle around data structures so that we can just pass block ids to free.