Yes, PeerBlock can slow down download speeds. It blocks over a billion IP addresses, including both undesirable and legitimate peers, resulting in a large number of blocked connections. This can significantly reduce download speeds.