diffusers

[Textual Inversion] Do not update other embeddings

#1665

Merged