PR #27548 Fix mistral generate for long prompt / response

Fix mistral generate for long prompt / response #27548

ArthurZucker merged 9 commits into huggingface:main from patch-1

Fix mistral generate for long prompt / response

db00c7b0

Add unit test

16441114

fix linter

fc863dbd

fix linter

ab0ef2c2

matheus-orby commented on 2023-11-17

fix test

4a3b24e6

Merge branch 'huggingface:main' into patch-1

a1e03264

gante approved these changes on 2023-11-21

gante commented on 2023-11-21

younesbelkada commented on 2023-11-21

younesbelkada approved these changes on 2023-11-21

gante requested a review from

ArthurZucker 2 years ago

ArthurZucker approved these changes on 2023-11-21

add assisted generation test for mistral and load the model in 4 bit …

10003209

Merge branch 'patch-1' of https://github.com/lorabit110/transformers …

9280d0c3

younesbelkada approved these changes on 2023-11-24

Merge branch 'main' into patch-1

c34fb57d

ArthurZucker merged b09912c8 into main 2 years ago

Reviewers

ArthurZucker

younesbelkada

gante

matheus-orby

Assignees

No one assigned

Labels

None yet

Milestone

No milestone