Add tiny model #47782
sushmanthreddy
wants to merge
26 commits into
huggingface:main
from
sushmanthreddy:add-tiny-model
Add TinyModel model scaffolding
4f99ba1a
Validate TinyModel attention dimensions
3f048523
Add TinyModel eager attention function
3ad6cb42
Initialize TinyModel attention projections
bba7ea78
Implement TinyModel attention forward pass
7f47236a
Allow standard TinyModel config kwargs
273fa0fb
Initialize TinyModel feed-forward network
a5ab34ac
Implement TinyModel feed-forward pass
39cca870
Mark TinyModel as cacheless
b339f97b
Initialize TinyModel decoder layer
f4db71a9
Implement TinyModel decoder layer forward pass
57f6db98
Initialize TinyModel weights
2337b128
Disable dynamic caching for TinyModel
d3987e38
Initialize the TinyModel backbone
763ad90c
Implement the TinyModel backbone forward pass
530ece91
Initialize TinyModel for causal language modeling
32e59900
Implement TinyModel causal language modeling
a0a3d53d
Convert TinyModel checkpoint state dictionaries
19ee5c8e
Save converted TinyModel checkpoints
722e9ae0
Add TinyModel checkpoint converter CLI
6bc60512
Default TinyModel generation to no cache
4da4b151
Integrate TinyModel with Transformers
e869ee3a
Add released TinyModel checkpoint regressions
28e439d5
Harden TinyModel checkpoint conversion
0272a40f
Handle tuple TinyModel outputs
8d228566
Use handwritten TinyModel sources
f1c11048
Login to write a write a comment.
Login via GitHub