Fix contact calling so that it updates recent numbers