Remove paddles from collision detection