PR #1811 Fixing frequency penalty

Commits

fix: take into account logits frequency so far in a generation stream when apply freq penalty

Narsil committed 1 year ago
chore: rebase and fix formatting

Narsil committed 1 year ago

text-generation-inference Fixing frequency penalty #1811 Merged