It depends on your definition of noise and outliers. Because the jagged edges (data points) of noisy data are close together, the single linkage is sensitive to any of these points.