PR #29791 [docs] LLM inference

[docs] LLM inference #29791

stevhliu merged 5 commits into huggingface:main from stevhliu:llm-optim

first draft

d75dbfba

tengomucho commented on 2024-03-22

feedback

c3a40922

khipp commented on 2024-03-25

SunMarc approved these changes on 2024-03-27

ArthurZucker commented on 2024-03-27

gante approved these changes on 2024-03-28

younesbelkada approved these changes on 2024-04-05

static cache snippet

5e6f1dee

stevhliu requested a review from

ArthurZucker 2 years ago

stevhliu requested a review from

amyeroberts 2 years ago

amyeroberts approved these changes on 2024-04-19

feedback

1c352faa

ArthurZucker approved these changes on 2024-04-22

tengomucho approved these changes on 2024-04-22

feedback

2b61fb2f

stevhliu merged e74d793a into main 2 years ago

stevhliu deleted the llm-optim branch 2 years ago

Reviewers

tengomucho

ArthurZucker

SunMarc

amyeroberts

younesbelkada

gante

khipp

Assignees

No one assigned

Labels

None yet

Milestone

No milestone