llama.cpp
gguf-py: Refactor and allow reading/modifying existing GGUF files
#3981
Merged
Overview
Commits
33
Changes
View On GitHub

gguf-py: Refactor and allow reading/modifying existing GGUF files #3981

monatis merged 33 commits into ggml-org:master from KerfuffleV2:feat-gguf-py-read-refactor
KerfuffleV2
KerfuffleV2 KerfuffleV2 added enhancement
KerfuffleV2 KerfuffleV2 added script
KerfuffleV2
cebtenzzre
KerfuffleV2 gguf-py: Refactor and add file reading support
b8c80df7
monatis
monatis commented on 2023-11-07
KerfuffleV2 Replay changes from #3871
8047aa19
KerfuffleV2 KerfuffleV2 force pushed from 0475e443 to 8047aa19 1 year ago
cebtenzzre
cebtenzzre commented on 2023-11-07
cebtenzzre
cebtenzzre commented on 2023-11-07
KerfuffleV2 Various type annotation fixes.
d7688dc9
KerfuffleV2 KerfuffleV2 force pushed from 4ab91057 to d7688dc9 1 year ago
cebtenzzre sort imports with isort (again)
a6f5742a
cebtenzzre
cebtenzzre commented on 2023-11-08
cebtenzzre
cebtenzzre commented on 2023-11-08
KerfuffleV2 Fix missing return statement in add_tensor
ce865b3c
cebtenzzre style cleanup with flake8
f364636b
cebtenzzre
cebtenzzre commented on 2023-11-08
cebtenzzre fix NamedTuple and Enum usage
f2292fcc
KerfuffleV2 Fix an issue with state init in GGUFReader
fffdac32
KerfuffleV2 Damagage is not a word.
b56ed661
KerfuffleV2 KerfuffleV2 changed the title gguf-py: Refactor and add file reading support gguf-py: Refactor and allow reading/modifying existing GGUF files 1 year ago
Galunid
KerfuffleV2
KerfuffleV2
cebtenzzre
cebtenzzre commented on 2023-11-09
chenqiny
Galunid
KerfuffleV2 Clean up gguf-py/examples/modify_gguf.py whitespace
4a5cd692
KerfuffleV2 Update gguf-py/examples/modify_gguf.py formatting
2af29ffe
KerfuffleV2 Update gguf-py/gguf/gguf_reader.py type hint
855486c9
KerfuffleV2 Make examples executable, formatting changes
2360aaad
KerfuffleV2 KerfuffleV2 requested a review from ggerganov ggerganov 1 year ago
KerfuffleV2
ggerganov
ggerganov approved these changes on 2023-11-09
KerfuffleV2 Add more information to GGUFReader and examples comments
8e250fe5
KerfuffleV2 Include a gguf Python package version bump
0d0306e7
KerfuffleV2 Merge branch 'master' into feat-gguf-py-read-refactor
cc58ad00
KerfuffleV2 Add convert-gguf-endian.py script
bca09625
KerfuffleV2
cebtenzzre
KerfuffleV2
cebtenzzre cleanup
233cb074
cebtenzzre
cebtenzzre commented on 2023-11-09
cebtenzzre gguf-py : bump minor version
5738b2f3
cebtenzzre
cebtenzzre approved these changes on 2023-11-09
KerfuffleV2
monatis
monatis commented on 2023-11-09
monatis
monatis requested changes on 2023-11-09
KerfuffleV2 Reorganize scripts
52bdc7e9
KerfuffleV2 Make GGUFReader endian detection less arbitrary
a04f0487
KerfuffleV2 Add JSON dumping support to gguf-dump.py
bd241db8
KerfuffleV2 A few for gguf-dump.py cleanups
382f9751
cebtenzzre
cebtenzzre commented on 2023-11-10
KerfuffleV2 Murder accidental tuple in gguf-py/scripts/gguf-dump.py
7d3580d5
cebtenzzre cleanup
5608cd8d
cebtenzzre constants : remove unneeded type annotations
795dc0f0
cebtenzzre fix python 3.8 compat
a21e9e71
KerfuffleV2 Set up gguf- scripts in pyproject.toml
eff662d6
KerfuffleV2 And include scripts/__init__.py, derp
0b0e726b
monatis
monatis approved these changes on 2023-11-10
KerfuffleV2
KerfuffleV2
KerfuffleV2 convert.py: We can't currently support Q8_0 on big endian.
960f912a
KerfuffleV2 gguf-py: SpecialVocab: Always try available sources for special token…
9ce51b69
KerfuffleV2
KerfuffleV2 KerfuffleV2 requested a review from cebtenzzre cebtenzzre 1 year ago
KerfuffleV2 KerfuffleV2 requested a review from monatis monatis 1 year ago
cebtenzzre cleanup
f22b2f20
cebtenzzre
cebtenzzre commented on 2023-11-10
KerfuffleV2 Promote add_X_token to GGUF metadata for BOS and EOS
4814b4bb
KerfuffleV2
monatis monatis merged 34b0a082 into master 1 year ago
monatis
chenqiny

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
enhancement script
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum