Adding in-memory representation of the address book