Add FALCON-40B Inference-Kernel Support #3656
RezaYazdaniAminabadi
wants to merge
15 commits into
master
from
ds-inference/add-falcon-support
Add FALCON auto-tp support
8b0ddc8a
Add the FALCON-40B kernel support
216c1203
Merge branch 'master' into ds-inference/add-falcon-support
9b10c1a9
add missing flacon-ploicy file
cad6ebd4
Merge branch 'ds-inference/add-falcon-support' of github.com:microsof…
3016e1d6
remove the debug code
2d54af9a
add checkpoint loading for flacon model
0df4059d
Merge branch 'master' into ds-inference/add-falcon-support
468c68ec
Merge branch 'master' into ds-inference/add-falcon-support
38b611de
Merge branch 'master' into ds-inference/add-falcon-support
f512587f
add the load-checkpoint support for falcon-40b (reducing loading time…
8c5967f4
more fixes on the ckpt loading
fe4cd2ef
fix a few issues & add falcon-7b support with meta-tensor loading
2108c701
add falcon test script
dfa4784c
some fixes for the the new Falcon Architecture
e1ba1077
Login to write a write a comment.
Login via GitHub