Pipes vibrate due to what’s called the “hammer” effect. This happens when water is abruptly turned off, resulting in the thumping and vibrating sound heard throughout the house.