llama.cpp
Feat: Support for `falcon-mamba` architecture
#9074
Merged

Feat: Support for `falcon-mamba` architecture #9074

younesbelkada
younesbelkada feat: initial support for llama.cpp
59a08be7
github-actions github-actions added python
younesbelkada fix: lint
bfa02868
younesbelkada refactor: better refactor
b97704c9
compilade
compilade commented on 2024-08-18
younesbelkada Update src/llama.cpp
343b5836
younesbelkada Update src/llama.cpp
a8109e35
younesbelkada fix: address comments
184a4c67
younesbelkada Update convert_hf_to_gguf.py
34942654
younesbelkada fix: add more cleanup and harmonization
f7d2e910
younesbelkada younesbelkada requested a review from compilade compilade 1 year ago
younesbelkada
younesbelkada fix: lint
9e22bb7e
compilade
compilade commented on 2024-08-18
younesbelkada Update gguf-py/gguf/gguf_writer.py
4553502d
younesbelkada fix: change name
d637bb97
compilade
compilade commented on 2024-08-18
younesbelkada Apply suggestions from code review
57c3eb41
younesbelkada add in operator
bf5e3440
younesbelkada younesbelkada requested a review from compilade compilade 1 year ago
younesbelkada younesbelkada force pushed to bf5e3440 1 year ago
younesbelkada fix: add `dt_b_c_rms` in `llm_load_print_meta`
ca4db9e5
younesbelkada younesbelkada force pushed to ca4db9e5 1 year ago
younesbelkada fix: correct printf format for bool
78ad84f0
younesbelkada fix: correct print format
7aeccbb7
compilade
compilade approved these changes on 2024-08-18
younesbelkada Update src/llama.cpp
5c0f108e
compilade
younesbelkada
compilade
younesbelkada
ggerganov
ggerganov approved these changes on 2024-08-19
mofosyne
compilade
compilade
younesbelkada
compilade llama : quantize more Mamba tensors
3491291a
compilade compilade added merge ready
LiuChaoXD
younesbelkada
younesbelkada
LiuChaoXD
younesbelkada
LiuChaoXD
ggerganov ggerganov merged b40eb848 into master 1 year ago
younesbelkada younesbelkada deleted the add-fm-support branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone