llama.cpp
Fixed Llama-3_1-Nemotron-51B doesn't work when 4K or more tokens
#11008
Merged

Fixed Llama-3_1-Nemotron-51B doesn't work when 4K or more tokens #11008

ggerganov merged 8 commits into ggml-org:master from master
ymcki
ymcki conflict resolution
ecad9665
ymcki Merge branch 'ggerganov:master' into master
12aded6c
ymcki move comments after bracket to its own line
643e5e8a
ymcki Merge branch 'ggerganov:master' into master
e68c76d1
ymcki Merge branch 'ggerganov:master' into master
6a4805f8
ymcki Merge branch 'ggerganov:master' into master
f9a1cdb3
ymcki Merge branch 'ggerganov:master' into master
c1736f30
ymcki DeciLMCausalModel now reads rope_theta from config.json properly
984ffac2
github-actions github-actions added python
slaren
slaren approved these changes on 2024-12-31
ggerganov
ggerganov approved these changes on 2024-12-31
ggerganov ggerganov merged bc7b1f86 into master 342 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone