Only balls with a player assigned should destroy bricks