transformers
Add Nemotron ASR Streaming
#46332
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
107
Changes
View On
GitHub
Add Nemotron ASR Streaming
#46332
eustlb
merged 107 commits into
main
from
nemotron-asr
add ParakeetForRNNT
e03fdbb6
ParakeetForRNNT config
328c94e3
generation mixin for RNNT
178a33b3
conversion script update
f406106b
auto mappings
38d72d87
tests
1efefcfc
eustlb
force pushed
from
de296c0c
to
55b042d5
171 days ago
eustlb
changed the base branch from
main
to
parakeet-rnnt-from-scratch
171 days ago
draft PR
e78d8f85
add chunking logic to the feature extractor
39182c74
on top of #46331
783f67e8
eustlb
force pushed
from
55b042d5
to
783f67e8
171 days ago
better streaming design
6d6dfa97
RNNT as the main class
aee4bb7b
rnn-t as main config
29f75424
nit
a90b87d4
wip: streaming encoder cache (pre-merge snapshot)
4ac90061
Merge remote-tracking branch 'origin/parakeet-rnnt-from-scratch' into…
721d9514
prop changes to modular
f962d4e6
nit
851a5d72
update test with reproducers
f38f7510
add RNN-T loss
a1c0785b
fix generate
b7e43d07
correct loss function usage
299f1494
processing handle ctc/rnnt/tdt diffs
23a01a99
udpate doc + fix pipeline
4bdf5c8b
working commit
9119f8c7
cleaner
d8739626
nits
17356f00
fix
fb763505
fix
d0d78c24
nit
eb35831e
add nemotron asr processor
63fc55b3
tmp commit
8908100d
update loss reduction to match NeMo
8c3e43ae
udpate expected value
f4f2c771
loss reduction
a67da591
loss reduction to tdt loss
ddcb571e
conversion udpate
182f4d53
fix
9b3ecc73
update checkpoint
a8e121b6
Merge branch 'main' into parakeet-rnnt-from-scratch
bc77d82b
nit
31a1ea7f
nit
3ae2ee49
fix tdt loss
9d6e6a69
fix loss
309fe6e2
fix loss test
99650000
make
6d041fb1
use correct checkpoint
cdfb7cca
Merge branch 'main' into parakeet-rnnt-from-scratch
bfb2eec6
AutoModelForRNNT in auto.md
d5b552ac
Merge branch 'parakeet-rnnt-from-scratch' of github.com:huggingface/t…
5d140793
add reproducable tests + other small fixes
1e39472b
fix
7632aa11
Merge branch 'main' into parakeet-rnnt-from-scratch
e98c3dcd
add revision
4207b26f
Merge branch 'parakeet-rnnt-from-scratch' of github.com:huggingface/t…
b784e393
Merge branch 'parakeet-rnnt-from-scratch' into nemotron-asr
2443e68e
nit
97909015
add loss
eb412997
fix
cc5e007f
nit
f9339d5e
better formulated forward
8871730d
add groups to VoxtralRealtimeCausalConv1d
f257e524
updates
7517d5de
clean up
6f21c7e8
add nemotron_asr to mapping for pipeline
49eaf96e
update doc
806895b3
eustlb
added
New model
eustlb
added
Audio
use inheritance on generate
d4daefe0
Base automatically changed from
parakeet-rnnt-from-scratch
to
main
162 days ago
draft streaming
dfc8f2e5
Merge remote-tracking branch 'origin/main' into nemotron-asr
53e68c01
nits
12297f93
fixes
44850165
update num_lookahead_tokens API
c6e12ad0
add streaming latency
5d3c299a
nit
1d230bf8
improve doc
18fab335
doc update
a1eda371
cleaning generation loop
97dffe49
fix
aead605f
Merge branch 'main' into nemotron-asr
57e8cea8
use hub checkpoints
227cbf08
udpate tests
c7e4df0d
NemotronAsrConfig update
03ebf543
Merge branch 'nemotron-asr' of github.com:huggingface/transformers in…
cecd05b6
update doc
3a063fca
NemotronAsr -> NemotronAsrStreaming
486494cb
update doc
bdd2e699
update license
1fb78a4d
nit
50c22936
test update
2ca01f78
eustlb
marked this pull request as ready for review
155 days ago
Merge branch 'main' into nemotron-asr
08f2d22e
eustlb
commented on 2026-06-18
ArthurZucker
approved these changes on 2026-06-18
make
fb2a580f
simplify a bit modular
4c1ef7f3
remove cached_property
9a5f8f0b
nit
7790f13e
improve comment
4abedd9a
refacto NemotronAsrStreamingEncoderSubsamplingConv2D
ca3c035f
address comment
083beaa0
add all_masked_rows as a kwarg
2667dea9
Merge branch 'main' into nemotron-asr
31cd80d3
rename fixtures
5b86bf1c
check-repo
c2be332d
Merge branch 'main' into nemotron-asr
7a518c10
use shorter streaming example to reduce compute
88f031c7
update test
9695a62e
Merge branch 'main' into nemotron-asr
986e0006
eustlb
enabled auto-merge
154 days ago
Merge branch 'main' into nemotron-asr
08cd7e65
fix tests
51c7f20e
Merge branch 'nemotron-asr' of github.com:huggingface/transformers in…
3539e6b9
eustlb
merged
ed51a079
into main
154 days ago
eustlb
deleted the nemotron-asr branch
154 days ago
Login to write a write a comment.
Login via GitHub
Reviewers
ArthurZucker
Assignees
No one assigned
Labels
New model
Audio
Milestone
No milestone
Login to write a write a comment.
Login via GitHub