You can use a filter to remove noise from a power supply just like you use filters to remove noise from a signal. Indeed, you can consider the output capacitors part of a filter that reacts against the output impedance of the power-supply circuit. Increasing the value of the output capacitance will reduce noise.