Add Kolibri 1
bdd66176
fix(kolibri1): fall back to the fp32 router upcast when dtypes differ
9dc8f10e
fix(kolibri1): reject configs without a sliding window
45787cd4
fix(kolibri1): drop the softmax load-balancing loss
babbb0a2
docs(kolibri1): use a Kolibri checkpoint in the causal LM example
3f82f3e8
docs(kolibri1): trim the expert-parallel plan comment
39712064
test(kolibri1): add integration tests on the BF16 checkpoint
760a66de
fix(kolibri1): update model name and contribution date
8278ab8b
Merge branch 'main' into add-kolibri1
58b2cf25
docs(kolibri1): note that the CUDA router fast path is for performance
66d0e696
hmellor
enabled auto-merge 37 days ago
hmellor
merged
6fb6859a
into main 37 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub