text-generation-inference
6ea570dd - fix microsoft/Phi-3-mini-4k-instruct crash in batch.slots[batch.slot_… (#2148)

Commit
1 year ago
fix microsoft/Phi-3-mini-4k-instruct crash in batch.slots[batch.slot_… (#2148) * fix microsoft/Phi-3-mini-4k-instruct crash in batch.slots[batch.slot_indices] Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> * Apply suggestions from code review --------- Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
Author
Parents
Loading