[Target] Remove unneeded deps (#218840)
After 050470e75fb67bfb059a88db87ab5b2be96e7515, these dependencies are
no longer needed in each target as the need for them is now specific to
the Passes library given that's where a big chunk of the
CodeGenPassBuilder implementation lives now.