diffusers

remove unused adapter weights in constructor

#5088

Merged