inference: fix bad effects for recursion (#51092)
Effects are not converged, so they need to always be correct, and not a
bestguess, even during recursion. This could be refined, but we don't
really need to, and it might be unnecessarily costly to do so.
