Add Parakeet-RNNT (#46331)
* add ParakeetForRNNT
* ParakeetForRNNT config
* generation mixin for RNNT
* conversion script update
* auto mappings
* tests
* RNNT as the main class
* rnn-t as main config
* nit
* update test with reproducers
* add RNN-T loss
* fix generate
* correct loss function usage
* processing handle ctc/rnnt/tdt diffs
* udpate doc + fix pipeline
* update loss reduction to match NeMo
* udpate expected value
* loss reduction
* loss reduction to tdt loss
* conversion udpate
* fix
* update checkpoint
* nit
* nit
* fix tdt loss
* fix loss
* fix loss test
* make
* use correct checkpoint
* AutoModelForRNNT in auto.md
* fix
* add revision
* Update src/transformers/loss/loss_rnnt.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* address review
* Update src/transformers/loss/loss_rnnt.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* hf paper alternative
* back to mean default for tdt loss
* re-add todo
* ensure bc
* add FIXTURES_DIR
* cleaner approach
* loss reduction as a kwarg
* revert reduction="mean" for BC in tdt loss
* add RNNTLossTest
* revert to inheritance on __init__
---------
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
