text-generation-inference

762dbf3f - fix: handle batches with and without grammars (#1676)

fix: handle batches with and without grammars (#1676) This PR correctly handles batches with a mixture of constrained and non constrained generations. Currently if batch contains mixed generations the generation will throw an error because it will incorrectly attempt to constrain a request with an empty grammar. We now handled `None` grammars and only apply the mask if needed Fixes: https://github.com/huggingface/text-generation-inference/issues/1643