transformers
Skip the query/key head repeat for grouped value heads in gated DeltaNet
#49141
Merged

Skip the query/key head repeat for grouped value heads in gated DeltaNet #49141

manav-simile
manav-simile Skip the query/key head repeat for grouped value heads in gated DeltaNet
42a1ede6
manav-simile Pass g and beta by keyword in test_gdn_chunked_matches_recurrent
d8fc223a
manav-simile Name the FLA version check fla_needs_equal_qk_heads
ea06c2a1
github-actions
manav-simile manav-simile marked this pull request as ready for review 50 days ago
github-actions github-actions requested a review from ArthurZucker ArthurZucker 50 days ago
github-actions github-actions requested a review from ydshieh ydshieh 50 days ago
Rocketknight1
vasqu
vasqu commented on 2026-09-28
ArthurZucker ArthurZucker removed review request from ArthurZucker ArthurZucker 43 days ago
manav-simile Always pass grouped query/key heads to the gated delta rule kernels
c90c1323
github-actions
manav-simile manav-simile requested a review from vasqu vasqu 23 days ago
manav-simile
vasqu
vasqu approved these changes on 2026-11-03
vasqu
manav-simile Add a helper for the gated delta rule test inputs
ae161204
manav-simile
vasqu
vasqu approved these changes on 2026-11-06
manav-simile Move the gated delta rule input helper into the model tester
86efa5c8
manav-simile
github-actions
vasqu
vasqu approved these changes on 2026-11-09
vasqu
vasqu
HuggingFaceDocBuilderDev
vasqu vasqu merged 6096273e into main 8 days ago
github-actions

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone