PR #2060 Add llama.cpp GPU offload option - SemanticDiff

Add llama.cpp GPU offload option #2060

oobabooga merged 5 commits into oobabooga:main from main

AlphaAtlas

AlphaAtlas

Add gpu layers to llamacpp_model.py

3d56218a

AlphaAtlas

Add argument to shared.py

6c7dea27

AlphaAtlas

AlphaAtlas

Malrama

AlphaAtlas

mayaeary

mayaeary commented on 2023-05-14

AlphaAtlas

Change argument in modules/llamacpp_model.py

cd6138d1

AlphaAtlas

Change argument in modules/shared.py

61b058cb

Malrama

james-s-tayler

oobabooga

Add docs

06e79d03

oobabooga

oobabooga

oobabooga merged 071f0776 into main 2 years ago

skatardude10

LiliumSancta

MNPS8

Thireus

AlphaAtlas

mlbrnm

shikage

Login to write a write a comment.

Login via GitHub

Reviewers

mayaeary

mayaeary

Assignees

No one assigned

Labels

None yet

Milestone

No milestone