parakeet : add support for NVIDIA Parakeet #3735
danbev
merged
80 commits into
ggml-org:master
from
danbev:parakeet-support
parakeet : add support for NVIDIA Parakeet
ad6274f8
ci : add -DGGML_NATIVE=OFF to windows job
661c9e29
ci : add GGML_BMI2=OFF to window job
1e0c5dd5
bhargav191098
commented
on 2026-04-21
examples : set flash attention to false for parakeet-cli [no ci]
1ed636a7
parakeet : initialize ggml_tensors pointers to nullptr [no ci]
ac396260
parakeet : remove non relavant fields in parakeet_state [no ci]
05ffa91e
parakeet : fix indentation in default params [no ci]
b899ce0b
parakeet : check and free ggml_backend_sched_t [no-ci]
9fe3b5cc
parakeet : group related types and helpers [no ci]
ceaa8bb9
parakeet : remove parakeet_full_parallel() API and implementation [no…
6e619881
parakeet : remove unused timeing fields [no ci]
66e6b093
parakeet : generate rel pos tensor in graph instead of in conversion …
2ad47d11
examples : print system info and timings for parakeet-cli [no ci]
42dcf192
parakeet : add missing free of batch.i_time [no ci]
2f9216f1
examples : add --output-txt and --output-file to parakeet-cli [no ci]
27cc5d7f
examples : add --no-prints to parakeet-cli
93806f4d
tests : add script to benchmark parakeet.cpp on LibriSpeech [no ci]
3f6b17c4
squash! tests : add script to benchmark parakeet.cpp on LibriSpeech […
d8b74e46
parakeet : enable model conversion on win [no ci]
3fa1f693
parakeet : add parakeet_reset_state function [no ci]
0c4f4bae
examples : reuse context in parakeet-cli [no ci]
cb611a44
Merge remote-tracking branch 'upstream/master' into parakeet-support
54ec90eb
parakeet : remove unused functions [no ci]
646976b8
parakeet : remove unused include [no ci]
5cc5a559
parakeet : zero initialize samples_padded [no ci]
f9dc4883
parakeet : add mel_worker_params struct [no ci]
64160ed2
parakeet : add missing eps to model output and align [no ci]
89d59f34
parakeet : fix n_tensor calculation and cleanup [no ci]
a8035411
parakeet : remove empty block [no ci]
a24a5dbd
parakeet : clean up comments [no ci]
ab031ed1
parakeet : clear tdt_stream_state in parakeet_reset_state
d9341017
parakeet : add parakeet_stream_clear helper function
7e0e274d
parakeet : minor cleanup of parakeet.h [no ci]
ab609b0a
parakeet : remove flash attention param
9164f9ce
Merge remote-tracking branch 'upstream/master' into parakeet-support
c68ab47d
Merge remote-tracking branch 'upstream/master' into parakeet-support
efab3e1b
parakeet : add progress_callback call
094fa51f
parakeet : call encoder_begin_callback
5edf4a56
parakeet : enable abort_callback to be called
319ccc47
Merge remote-tracking branch 'upstream/master' into parakeet-support
cb7725c9
parakeet : replace hardcode dimensions [no ci]
9f1b4307
parakeet : add missing n_conv_kernel from orig model [no ci]
a24aa3f2
parakeet : remove more hardcoded dimensions/values [no ci]
9c995753
parakeet : add small test model and generator script
83b618e6
parakeet : updated test model to avoid NaN
14433016
parakeet : fix segment fault in test-parakeet-stream
78db596c
Merge remote-tracking branch 'upstream/master' into parakeet-support
29933c42
fix asan issue with test model
8302e8e9
Merge remote-tracking branch 'upstream/master' into parakeet-support
a8cc3fab
Merge remote-tracking branch 'upstream/master' into parakeet-support
3ce5332c
parakeet : remove flash attn options from README.md [no ci]
da55e1e9
parakeet : add exception handling to parakeet_model_load [no ci]
ce4e756a
cmake : use CMAKE_INSTALL_LIBDIR for parakeet.cpp [no ci]
2d5219ad
ggerganov
commented
on 2026-06-08
parakeet : remove unnecessary ggml_cont operations
b9ea94a5
parakeet : remove redundant ggml_cont in encoder graph
0bfa13d8
parakeet : merge/fuse subsampling and encoder
fa763f6a
ggerganov
commented
on 2026-06-08
ggerganov
commented
on 2026-06-08
parakeet : remove streaming path from parakeet_full_with_state
8cd97184
parakeet : add parakeet_stream_params [no ci]
4d410be4
parakeet: use local encoder attention for long audio
78c82d91
parakeet : support f16 model conversion [no ci]
ac935e3b
parakeet : add quantization support [no ci]
0764628b
tests : update run-tests.sh to support parakeet models [no ci]
f55f7eb6
parakeet : fix parakeet_log_callback_default [no ci]
c1d57fac
parakeet : clean up of local attention [no ci]
94c226b7
parakeet : clarify stride-shift code comment [no ci]
210c05e4
scripts : add quantize-parakeet.sh script [no ci]
804771cc
parakeet : fix skip list in parakeet-quantize [no ci]
b0946f4d
scripts : use Q8_0 as the example in parakeet model card [no ci]
9fef5882
ggerganov
commented
on 2026-06-12
scripts : add ggml- prefix to HF models [no ci]
81d14697
parakeet : add prediction timing and fix sample time [no ci]
572a7980
parakeet : use persistent tensor for encoder output
c5b308a0
parakeet : rename whisper_backend_init_gpu
eb8f8245
parakeet : avoid copying pred_h as input to joint network
80e68a87
parakeet : avoid forcing token embedding lookup onto CPU
23b2eb51
parakeet : reduce operations in LSTM layers
0024ebd8
parakeet : update for-tests-ggml-parakeet-dtd.bin
7c06be78
ggerganov
commented
on 2026-06-16
parakeet : correct packed gates comment [no ci]
e11a11e8
parakeet : use ggml-org HF org [no ci]
b05d775c
Merge remote-tracking branch 'upstream/master' into parakeet-support
17888aec
Merge remote-tracking branch 'upstream/master' into parakeet-support
8cc78810
Login to write a write a comment.
Login via GitHub