The withdrawal agreement came Sunday in a letter to the International Atomic Energy Agency in Vienna .