[GLM-Image] Add batch support for GlmImagePipeline (#13007)
* init
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* change from right padding to left padding
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* try i2i batch
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* fix: revert i2i prior_token_image_ids to original 1D tensor format
* refactor KVCache for per prompt batching
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* fix KVCache
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* fix shape error
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* refactor pipeline
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* fix for left padding
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* insert seed to AR model
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* delete generator, use torch manual_seed
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* add batch processing unit tests for GlmImagePipeline
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* simplify normalize images method
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* fix grids_per_sample
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* fix t2i
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* delete comments, simplify condition statement
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* chage generate_prior_tokens outputs
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* simplify if logic
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* support user provided prior_token_ids directly
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* remove blank lines
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* align with transformers
Signed-off-by: JaredforReal <w13431838023@gmail.com>
* Apply style fixes
---------
Signed-off-by: JaredforReal <w13431838023@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
