PR #21161 cpp: Adding new arch RUGPT3XL

cpp: Adding new arch RUGPT3XL #21161

EvilFreelancer wants to merge 2 commits into ggml-org:master from EvilFreelancer:gg/rugpt3xl

Support of Sparse Attention added

1c6a5e61

EvilFreelancer requested a review from

CISC 2 days ago

EvilFreelancer requested a review from

ggerganov 2 days ago

EvilFreelancer changed the title ~~Adding new~~ cpp: Adding new arch RUGPT3XL 2 days ago

github-actions added model

github-actions added python

Multi-stream batching fix

759db688

Reviewers

CISC

ggerganov

Assignees

No one assigned

Labels

model python

Milestone

No milestone