Add the policy to run llama model from the official repo #4313
RezaYazdaniAminabadi
merged
19 commits into
master
from
add-llama2-support
Add the llama2 support from the official llama repo
476ca30c
add back commented function
6cabd625
add new policy & implementation for llama2
7b2142c7
RezaYazdaniAminabadi
changed the title
add some changes to inject/run the 70b llama model
f5d987d1
remove debugging code
c2c2d6b6
remove more debugging code
165042df
Merge branch 'master' into add-llama2-support
81d692d0
formatting
24a3a0f2
Merge branch 'master' into add-llama2-support
c0ca80e8
Merge branch 'master' into add-llama2-support
3e3945eb
Merge branch 'master' into add-llama2-support
b37f7d86
use num_kv only when it has positive value
c33bc4fd
Merge branch 'add-llama2-support' of github.com:microsoft/DeepSpeed i…
ca61bd1e
use the num_kv param only if it is positive
db5a3b7f
Merge branch 'master' into add-llama2-support
d0abfdda
fix syntax and format errors.
297a15cd
fix an issue with the float32 transform kernel
a87860d2
Merge branch 'add-llama2-support' of github.com:microsoft/DeepSpeed i…
10a1df25
Merge branch 'master' into add-llama2-support
c72aa76a
awan-10
approved these changes
on 2023-09-19
mrwyattii
approved these changes
on 2023-09-19
lekurile
approved these changes
on 2023-09-19
Login to write a write a comment.
Login via GitHub