Adding support for llama2.c models #2559
klosax
merged
32 commits into
ggml-org:master
from
byte-6174:master
first crack at lamma2.c model conversion
f4519830
add the new example directory in gitignore
78f8e4d6
WIP: super not working attempt atm. will update as I learn more ggml :D
a9019963
Updated makefile to compile rough tests
912fc590
Adding a doc that shows mappings that are coded in between llama.c <-…
485e62b1
adding the rough attempt to convert the model
cc5c67be
saving the file with all the variables found in llama.c model
b3aa1073
updating makefile to compile finalized version
af9caca4
updating gitignore to ignore additional binaries
817cc20f
output vector is not part of llama.c model file
5a87675d
fixing bug that didnt unroll the 1d karpathy arrays
aebccdbf
more bug fixn
f1c03f4b
cleaning up code a little bit with removing extra printfs needed duri…
df659f6b
updating makefile so test scripts are not compiled
ff9fae57
updating readme for instructions for compilation and use
2a0138e5
minor spacing update
9a09e641
Merge branch 'ggerganov:master' into master
3c0c1553
updating makefile so my initial tests are not compiled
223ddb77
updating gitignore
088eb86f
cleaning up some earlier files used for experiments
08e94332
cleaning up Makefile empty space before mearge
5520876c
klosax
approved these changes
on 2023-08-08
cleaning up to remove spaces and satisfy failed checks
d14c066f
SlyEcho
requested changes
on 2023-08-09
adding add_subdirectory in examples dir CMakeLists.txt
7b1f0626
adding newline in readme
7d0404c3
removing 1 whitespace
afb8f6ee
adding CMakeLists.txt file in the conversion script directory
40a51ec6
for got to add newline
a3fa0aba
SlyEcho
approved these changes
on 2023-08-09
SlyEcho
requested changes
on 2023-08-10
Adding more information in the README to use conversion tool.
db5d7ab3
commandline argument changes for clarity.
aab15de4
refactor vocab loading into its own method
d2b95e7e
also support loading from llama2.c vocabulary
aa262012
Merge pull request #1 from jrudolph/convert-llama2-vocab
52801c05
SlyEcho
approved these changes
on 2023-08-11
Login to write a write a comment.
Login via GitHub