text-generation-inference

8332fc49 - fix: use get_speculate to the number of layers (#1737)