If speed is reduced during speed limit, don't speed up again afterwards