llama.cpp
Add support for BitnetForCausalLM (new model / new datatype)
#7931
Merged
Merged
Add support for BitnetForCausalLM (new model / new datatype) #7931
ggerganov
merged
38 commits into
ggml-org:master
from
Eddie-Wang1120:bitnet
hf bitnet v1
076b4a19
hf bitnet e2e v2
57dfc3bc
finish bitnet e2e
1f2e0ee0
finish f16 hf bitnet e2e
5e596601
remove unsed
2a01a7ce
finish bitnet i2 e2e
4e1ab506
move i2s to quantize v1
ca090855
move i2 to quantize
dbee0a86
clean code
1c5a8b7f
clean code 2
3a0f8b06
fix codestyle
97d22be5
fix code
344467f2
fix
65ac3a36
fix code
abd798d7
Merge branch 'ggerganov:master' into bitnet
841c903f
fix merge
c0fd4df8
remove unused
de1d5073
Merge branch 'ggerganov:master' into bitnet
2322e9db
Merge branch 'ggerganov:master' into bitnet
c0cd08d4
change table name
f395dd9c
fix whitespace
5e5eee7b
compilade
commented
on 2024-06-14
delete redundant
7a8961ff
i2_s to absmax
95dced07
finish i2_s/i8_s vec_dot x86 simd
569a03ed
i2s->q22
a03eff31
fix code
4edc958f
compilade
commented
on 2024-06-18
remove block scale
89c7e4c1
compilade
commented
on 2024-06-18
add dequantize
fcf2da46
fix seq
fa9a742b
compilade
commented
on 2024-06-19
update avx2
230396bc
Green-Sky
commented
on 2024-06-20
remove q2_2
2b097682
remove q22_grid
a58cf0d6
Merge branch 'ggerganov:master' into bitnet
abcdc503
fix whitespace
c6ddfa7e
reuse llm_build_kv
55a57a50
Merge branch 'ggerganov:master' into bitnet
0520d88e
slaren
approved these changes
on 2024-06-21
ggerganov
approved these changes
on 2024-06-23
ggerganov
commented
on 2024-06-23
Green-Sky
approved these changes
on 2024-06-23
ggerganov
commented
on 2024-06-23
Merge branch 'ggerganov:master' into bitnet
16f0c30d
fix bo
226c5eed
Login to write a write a comment.
Login via GitHub