Unlike other built-in apps on your iPhone, the Contact app does not have a Recently Deleted folder where all deleted numbers are stored. That is why it is advisable to backup all the contacts to iCloud or ensure the number is inactive.