PR #5180 Add gpt-fast loader (pure PyTorch) - SemanticDiff

Add gpt-fast loader (pure PyTorch) #5180

oobabooga wants to merge 6 commits into dev from gpt-fast

oobabooga

oobabooga

Add gpt-fast support

b4f1ca9f

oobabooga

Autoset the device

88640a75

oobabooga

Improved cache handling

5886450a

oobabooga

Remove redundant variables

ba222f01

oobabooga

Remove debug code

c5f3ceae

oobabooga

Remove torch.cuda code

587980ba

lufixSch

oobabooga

rraulison

oobabooga

valiray

oobabooga

oobabooga

oobabooga closed this 1 year ago

oobabooga

oobabooga deleted the gpt-fast branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone