working with the wall shake, actualy only start moving with the velocity when a ball hit the wall, maybe the wall is sleeping and the ball wake it and this is the reason.