Add Kolibri 1 #49463

hmellor merged 10 commits into huggingface:main from lucamotz:add-kolibri1
lucamotz
lucamotz Add Kolibri 1
bdd66176
Cyrilvallez
Cyrilvallez commented on 2026-10-09
wsascha fix(kolibri1): fall back to the fp32 router upcast when dtypes differ
9dc8f10e
wsascha fix(kolibri1): reject configs without a sliding window
45787cd4
wsascha fix(kolibri1): drop the softmax load-balancing loss
babbb0a2
wsascha docs(kolibri1): use a Kolibri checkpoint in the causal LM example
3f82f3e8
wsascha docs(kolibri1): trim the expert-parallel plan comment
39712064
wsascha test(kolibri1): add integration tests on the BF16 checkpoint
760a66de
ericschreiber fix(kolibri1): update model name and contribution date
8278ab8b
Cyrilvallez Merge branch 'main' into add-kolibri1
58b2cf25
github-actions
github-actions
HuggingFaceDocBuilderDev
Cyrilvallez
Cyrilvallez approved these changes on 2026-10-13
Cyrilvallez
github-actions
github-actions
github-actions
lucamotz docs(kolibri1): note that the CUDA router fast path is for performance
66d0e696
hmellor hmellor enabled auto-merge 37 days ago
github-actions
github-actions
hmellor hmellor merged 6fb6859a into main 37 days ago
vasqu vasqu added New model

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone