text-generation-inference

c4ebcea7 - Fixing default for BNB + cuda graphs (they don't work together).