Improve decoding #291

ggerganov merged 23 commits into master from decoding
ggerganov
ggerganov ggerganov force pushed from f06b991d to 4c5527b1 3 years ago
ggerganov ggerganov force pushed from 4c5527b1 to 20b64fc2 2 years ago
ggerganov whisper : prepare infra for new decoding strategies
abe104b8
ggerganov whisper : apply logit filters and compute logprobs
2d8d3724
ggerganov whisper : add whisper_get_logits()
21559537
ggerganov whisper : separate self and cross attention memory
523e0494
ggerganov ggerganov added this to the 1.1.0 milestone 2 years ago
ggerganov whisper : move probs_id buffer to whisper_context
1163f266
ggerganov whisper : refactor kv cache into separate struct
ee58108d
ggerganov ggerganov force pushed from 20b64fc2 to ee58108d 2 years ago
ggerganov whisper : move self-attention kv cache to whisper_decoder
628843c6
ggerganov whisper : wip decoding parameters + strategies
9551d7fa
ggerganov whisper : wip decoding parameters + strategies (part 2)
3d723d0b
ggerganov whisper : wip decoding parameters + strategies (part 3)
116dd67a
ggerganov whisper : wip decoding parameters + strategies (part 4)
bd6e70b5
ggerganov whisper : fix prompt_past update to not include prompt_init
712bc4b9
ggerganov whisper : temperature + best_of support
34c5110f
ggerganov whisper : support for compression_ration_threshold
c67716fa
ggerganov command : fix example to use logits instead of obsolete probs
7ea1b736
ggerganov whisper : handle empty sequence ranking
c6a8a470
ggerganov whisper : add WHISPER_DEBUG + diagnostic prints + new main args
c301a794
ggerganov whisper : minor fixes
5e97f80f
ggerganov whisper : add beam-search support
5548a198
ggerganov whisper : bug fix when there no previous context
6700cd57
ggerganov ggerganov marked this pull request as ready for review 2 years ago
ggerganov
stevevaius2015
ggerganov whisper : add comments
d83e4757
ggerganov stream : disable temperature fallback
3fe33d61
ggerganov whisper.swiftui : update example - fix paths + add empty folders
6a2f4dbc
ggerganov ggerganov merged 8de452c1 into master 2 years ago
ggerganov ggerganov deleted the decoding branch 2 years ago
RndyP
RndyP
ggerganov
dennislysenko

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone