ochafik/llama.cpp

Pull Requests Commits
Add Command R chat template (#6650)
jc19chaoj committed 2 years ago
Verified 04fbc5f2
flake.lock: Update (#6669)
ggerganov committed 2 years ago
Verified f184dd92
Added support for GGML_OP_CLAMP in Metal (#6662)
dave-fl committed 2 years ago
Verified 422c2aff
Fix --split-max-size (#6655)
CISC committed 2 years ago
Verified 8800226d
[bug fix] convert github repository_owner to lowercase (#6673)
jaeminSon committed 2 years ago
Verified e689fc4e
convert : enable the `--use-temp-file` cli flag (#6645)
jac-jim committed 2 years ago
Verified a4ec34e1
fix memcpy() crash, add missed cmd in guide, fix softmax (#6622)
NeoZhangJianyu committed 2 years ago
Verified de17e3f7
CUDA: fix matrix multiplication logic for tests (#6667)
JohannesGaessler committed 2 years ago
Verified b5e7285b
model: support arch `DbrxForCausalLM` (#6515)
phymbert committed 2 years ago
Verified 4bd0f93e
JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)
ochafik committed 2 years ago
Verified ab9a3240
metal : unify mul_mv_id kernels (#6556)
slaren committed 2 years ago
Verified fbbc030b
infill : add download instructions for model (#6626)
danbev committed 2 years ago
Verified 4cc120c7
server : coherent log output for KV cache full (#6637)
phymbert committed 2 years ago
Verified 24ee66ed
llama : add gguf_remove_key + remove split meta during quantize (#6591)
zj040045 committed 2 years ago
Verified 91c73601
chore: Fix markdown warnings (#6625)
reneleonhardt committed 2 years ago
Verified 5c4d767a
imatrix : remove invalid assert (#6632)
ggerganov committed 2 years ago
Verified ef21ce4c
Correct free memory and total memory. (#6630)
MasterYi1024 committed 2 years ago
Verified dee7f8d6
eval-callback: use ggml_op_desc to pretty print unary operator name (#6631)
phymbert committed 2 years ago
Verified 81da18e7
ci : disable Metal for macOS-latest-cmake-x64 (#6628)
ggerganov committed 2 years ago
Verified 9ed2737a
Optimization: eliminate addition of redundant stacks when advancing grammar. (#6616)
HanClinto committed 2 years ago
Verified 04a5ac21
As suggested by @slaren, disabling Metal for test to fix CI build on OSX from #6576 (#6619)
HanClinto committed 2 years ago
Verified f7001ccc
Refactor Error Handling for CUDA (#6575)
nneubacher committed 2 years ago
Verified a474f50e
grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609)
ochafik committed 2 years ago
Verified cbaadc92
ci: download artifacts to release directory (#6612)
Hugi-R committed 2 years ago
Verified 1bbdaf6e
scripts : add --outdir option to hf.sh (#6600)
danbev committed 2 years ago
Verified f4183afe
eval-callback: Example how to use eval callback for debugging (#6576)
phymbert committed 2 years ago
Verified b804b1ef
gguf : add option to not check tensor data (#6582)
danbev committed 2 years ago
Verified 8228b66d
minor layout improvements (#6572)
rsoika committed 2 years ago
Verified b3a96f27
llama : add model types for mixtral (#6589)
slaren committed 2 years ago
Verified 4f407a0a
convert.py : add consolidated.safetensors for mixtral 8x22b (#6587)
slaren committed 2 years ago
Verified 65c64dc3
Terms Of Use Privacy Policy Refund Policy Impressum