Add Nemotron ASR Streaming (#46332)
* add ParakeetForRNNT
* ParakeetForRNNT config
* generation mixin for RNNT
* conversion script update
* auto mappings
* tests
* draft PR
* add chunking logic to the feature extractor
* on top of #46331
* better streaming design
* RNNT as the main class
* rnn-t as main config
* nit
* wip: streaming encoder cache (pre-merge snapshot)
* prop changes to modular
* nit
* update test with reproducers
* add RNN-T loss
* fix generate
* correct loss function usage
* processing handle ctc/rnnt/tdt diffs
* udpate doc + fix pipeline
* working commit
* cleaner
* nits
* fix
* fix
* nit
* add nemotron asr processor
* tmp commit
* update loss reduction to match NeMo
* udpate expected value
* loss reduction
* loss reduction to tdt loss
* conversion udpate
* fix
* update checkpoint
* nit
* nit
* fix tdt loss
* fix loss
* fix loss test
* make
* use correct checkpoint
* AutoModelForRNNT in auto.md
* add reproducable tests + other small fixes
* fix
* add revision
* nit
* add loss
* fix
* nit
* better formulated forward
* add groups to VoxtralRealtimeCausalConv1d
* updates
* clean up
* add nemotron_asr to mapping for pipeline
* update doc
* use inheritance on generate
* draft streaming
* nits
* fixes
* update num_lookahead_tokens API
* add streaming latency
* nit
* improve doc
* doc update
* cleaning generation loop
* fix
* use hub checkpoints
* udpate tests
* NemotronAsrConfig update
* update doc
* NemotronAsr -> NemotronAsrStreaming
* update doc
* update license
* nit
* test update
* make
* simplify a bit modular
* remove cached_property
* nit
* improve comment
* refacto NemotronAsrStreamingEncoderSubsamplingConv2D
* address comment
* add all_masked_rows as a kwarg
* rename fixtures
* check-repo
* use shorter streaming example to reduce compute
* update test
* fix tests
