transformers
Generate: Fix modern llm `generate` calls with `synced_gpus`
#34095

Merged

Commits

sync gpus

gante committed 1 year ago
sync gpus

gante committed 1 year ago
fix other decoding methods

gante committed 1 year ago
nit

gante committed 1 year ago
fix assisted gen (consistent return api)

gante committed 1 year ago

Loading