PR #3171 Add tensor split support for llama.cpp

Add tensor split support for llama.cpp #3171

oobabooga merged 4 commits into oobabooga:dev from shouyiwang:ts2

Add tensor_split parameter support

1a8752ff

Change [0.0] to None for default tensor_split

2d26a07a

Add support for llamacpp_HF

2a16c3bf

Merge branch 'main' into ts2

e8f99597

oobabooga changed the base branch from main to dev 2 years ago

oobabooga merged 031fe722 into dev 2 years ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone