transformers
change shape to support dynamic batch input in tf.function XLA generate for tf serving
#18372
Merged
Overview
Commits
2
Changes
View On GitHub

change shape to support dynamic batch input in tf.function XLA generate for tf serving #18372

gante merged 2 commits into huggingface:main from nlpcat:fix.generate.batch
nlpcat
nlpcat nlpcat marked this pull request as ready for review 3 years ago
HuggingFaceDocBuilderDev
nlpcat nlpcat force pushed 3 years ago
nlpcat nlpcat changed the title change shape to support dynamic batch input in tf.function XLA generate change shape to support dynamic batch input in tf.function XLA generate for tf serving 3 years ago
nlpcat
gante
gante
gante approved these changes on 2022-08-03
gante gante requested a review from sgugger sgugger 3 years ago
sgugger
sgugger approved these changes on 2022-08-03
gante
change shape to support dynamic batch input in tf.generate
14c127ff
add tests
596ecf40
nlpcat nlpcat force pushed to 596ecf40 3 years ago
nlpcat
gante
gante gante merged fc1d841b into main 3 years ago
s4sarath
rafaellemay
gante

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum