Support StableLM2 12B #6635
ggerganov
merged
25 commits into
ggml-org:master
from
ashishdatta:stablelm-12b
ggerganov
requested changes
on 2024-04-12
Galunid
commented
on 2024-04-13
compilade
commented
on 2024-04-13
compilade
commented
on 2024-04-13
StableLM2 12B support for huggingface -> GGUF
d383c0d8
StableLM12 tensormapping and constants
13387d9c
StableLM-2-12b model support
b89fa973
fix
b5afc447
Added 12B support
0eb8492c
Removed autoformatting; resolved bug where model_arch was not selecti…
15a5e7db
Formatting
91a3db9e
Do QK norm stacking in model conversion step
29d940b0
Converge StableLM and StableLM2 code to simplify graph construction
0ec53cff
Fix accidental removal
8dcd9978
Removed warnings
0dc779bf
Galunid
commented
on 2024-04-14
Galunid
commented
on 2024-04-14
Revert formatter
f7b40d76
Move QK norm stack to private function so it's easier to read
e3f73604
Galunid
commented
on 2024-04-14
refactor stablelm graph builder to support 1.6, 3b and 12b more effic…
96695fb9
Proper check for None type for new_name to avoid crash; formatting; r…
13c75c21
Format
412a2807
Formatting
91728faa
format
bf1a9a55
Fix incorrect check for K norm
d2ab6930
space after commas; Keep indentation multiple of 4 spaces
b7f984a0
Flake8 format
1f6929e5
ggerganov
commented
on 2024-04-16
Removed unnecessary conditional branches
8a15f932
compilade
commented
on 2024-04-16
Removed unused comment
6ae4dad0
compilade
commented
on 2024-04-16
Fixed incorrect tensor passing
e6ec2033
Format
94e8c490
ggerganov
approved these changes
on 2024-04-16
Galunid
approved these changes
on 2024-04-16
Login to write a write a comment.
Login via GitHub