Baseballs are replaced 3-7 times in an average baseball game. A ball is replaced when it becomes too dirty or damaged to be used safely and fairly. The umpire is responsible for determining when a ball needs to be replaced and will signal for a new one to be brought in. Also, if the ball is hit out of play and into the stands, then they don’t ask baseball fans for the ball back; instead, they get a new ball.