Revert "Expire cached blocks using a sweeper_helper on all sweepers"

This reverts commit bd9c1ee5f6a3bdaacc6e03d81dc4c6c51e805639.