llama.cpp
IMPORTANT: Introduce C-style API - Major Refactoring
#370

Merged

IMPORTANT: Introduce C-style API - Major Refactoring #370

ggerganov merged 8 commits into master from c-api

Major refactoring - introduce C-style API

9af8f797

Clean up

f9d4a0ed

Add <cassert>

90d07b52

Add <iterator>

cae6e8a0

Add <algorithm> ....

4d2e0353

Green-Sky added high priority

gjmulder added enhancement

blackle commented on 2023-03-21

sw commented on 2023-03-21

j-f1 commented on 2023-03-21

Green-Sky requested changes on 2023-03-21

slaren commented on 2023-03-22

Fix timing reporting and accumulation

71ed3d22

Measure eval time only for single-token calls

a9f900b6

Change llama_tokenize return meaning

c3d13eaa

ggerganov merged f5a77a62 into master 2 years ago

ggerganov deleted the c-api branch 2 years ago

Reviewers

Green-Sky

slaren

niansa

anzz1

Ronsor

j-f1

blackle

Assignees

No one assigned

Labels

enhancement high priority

Milestone

No milestone