transformers
Support Granite Speech NAR (NLE)
#46031
Open

Support Granite Speech NAR (NLE) #46031

avihu111 wants to merge 40 commits into huggingface:main from avihu111:granite_speech_nar
avihu111
avihu111 support granite speech nar model
7c816f90
avihu111 attempt to use modular - inherit from the Granite base LLM - changing…
bb5b6482
avihu111 minor
a46f94d2
avihu111 minor
925bfdb8
avihu111 minor
daf4f931
avihu111 add docs, rename components, skip submodule tests
65729c2f
avihu111 fix check_config_docstrings_have_checkpoints
fa81168e
avihu111 add dates
f72b3335
avihu111 save processor imports
151c7090
avihu111 avoid a crash without torch available
d5d851c3
avihu111 fix unguarded torch usage in typing
0c29229b
avihu111 avihu111 changed the title support granite speech nar model Support Granite Speech NAR (NLE) 29 days ago
avihu111 minor
e5921811
avihu111 avihu111 marked this pull request as ready for review 29 days ago
github-actions github-actions requested a review from ArthurZucker ArthurZucker 29 days ago
github-actions github-actions requested a review from Rocketknight1 Rocketknight1 29 days ago
avihu111 clean up variable names, avoid spliting the language_model/lm_head fo…
480801cc
eustlb eustlb assigned eustlb eustlb 29 days ago
eustlb eustlb added New model
eustlb eustlb added Audio
avihu111 change encoder bpe prediction head to match the editor. (original voc…
2a95b12a
avihu111 Merge branch 'main' of https://github.com/avihu111/transformers into …
43e739a9
avihu111 add integration tests for granite speech nar
16efa340
avihu111 ruff newline
4707df0d
avihu111 minor fixes after pulling main
18abe6e9
avihu111 minor
8da331d8
eustlb
eustlb commented on 2026-05-26
avihu111 - renames (GraniteSpeechNarForCTC, generate)
e0a51e5d
avihu111 shared helper methods for ctc loss and ctc decoding, shared between t…
3fc93c21
avihu111 move the encoding code to GraniteSpeechNarModel, keep just the lm_hea…
97e7c1bb
avihu111 add logits scaling (as used in granite lm_head)
367e0ee0
avihu111 add multi-step editing support. (without recomputing audio_embeds)
3db6757c
avihu111 minor
17bc4b6d
avihu111
avihu111 - resolve a depracation warning
77eb5434
eustlb
eustlb commented on 2026-06-03
avihu111 Update src/transformers/models/granite_speech_nar/modular_granite_spe…
36f27454
avihu111 Update src/transformers/models/granite_speech_nar/modular_granite_spe…
70c06b58
avihu111 simplify: encoder always has bpe head
3ffc7798
avihu111 use @capture_outputs for encoder hidden states
0d6af418
avihu111 Update src/transformers/models/granite_speech_nar/modular_granite_spe…
67b3303e
avihu111 Update src/transformers/models/granite_speech_nar/modular_granite_spe…
7d034571
avihu111 Update src/transformers/models/granite_speech_nar/modular_granite_spe…
fd8fa8af
avihu111 simplify setting is_causal=False
212668f2
avihu111 use more standard tests
c1223d46
avihu111 minor fixes after refactoring the tests
032cc088
avihu111 minor
dc7901b8
avihu111 resolve some issues in the tests:
28fed5e3
avihu111 stack logits to pass test_determinism
77473e55
avihu111 make labels test consistent
8d089f5d
github-actions

Login to write a write a comment.

Login via GitHub

Assignees
Labels
Milestone