Fix Decoding For Long Tokens (#187)

Commit

1 year ago

Fix Decoding For Long Tokens (#187) * Add buffer for long token decoding * Ignore OOV tokens (token_id > vocab_size) during decoding