llama.cpp
convert-hf : save memory with lazy evaluation
#7075
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
26
Changes
View On
GitHub
convert-hf : save memory with lazy evaluation
#7075
compilade
merged 26 commits into
master
from
compilade/lazy-convert-hf
convert-hf : begin refactoring write_tensor
47e02eb7
Merge branch 'master' into compilade/convert-hf-refactor
0d720acb
convert : upgrade to sentencepiece v0.2.0
c33775bc
convert-hf : remove unused n_dims in extra_*_tensors
698f0b34
convert-hf : simplify MoE weights stacking
cde9ea65
convert-hf : flake8 linter doesn't like semicolons
56f60f5d
convert-hf : allow unusual model part names
3870164f
convert : use a string for the SentencePiece tokenizer path
dcd8dfa1
convert-hf : display tensor shape
21068b6b
convert-hf : convert norms to f32 by default
639b374b
convert-hf : sort model part names
644c2696
convert-hf : use an ABC for Model again
ce067af1
convert-hf : use a plain class for Model, and forbid direct instantia…
13f4cf70
Merge branch 'master' into compilade/convert-hf-refactor
6a54973d
Merge branch 'master' into compilade/convert-hf-refactor
3e5e0dce
convert-hf : more consistent formatting of cmdline args
98f2d0e0
convert-hf : align the message logged for converted tensors
f2099c50
compilade
added
enhancement
compilade
added
need feedback
convert-hf : fix Refact conversion
215a0d38
convert-hf : save memory with lazy evaluation
f09674fb
convert-hf : flake8 doesn't like lowercase L as a variable name
0c383328
convert-hf : remove einops requirement for InternLM2
98db4347
compilade
force pushed
from
b361d693
to
98db4347
1 year ago
convert-hf : faster model parts loading
bc78bf4c
convert-hf : minor changes for consistency
62303e7f
ggerganov
added
high priority
compilade
changed the base branch from
compilade/convert-hf-refactor
to
master
1 year ago
Merge branch 'master' into compilade/lazy-convert-hf
68c5ac62
gguf-py : add tqdm as a dependency
94e667a9
ggerganov
approved these changes on 2024-05-07
Galunid
approved these changes on 2024-05-08
Merge branch 'master' into compilade/lazy-convert-hf
bffdaf40
compilade
force pushed
from
1eccde6f
to
bffdaf40
1 year ago
compilade
force pushed
from
cad22e17
to
bffdaf40
1 year ago
compilade
merged
f98eb31c
into master
1 year ago
Login to write a write a comment.
Login via GitHub
Reviewers
ggerganov
Galunid
Assignees
No one assigned
Labels
enhancement
high priority
need feedback
Milestone
No milestone
Login to write a write a comment.
Login via GitHub