Populate contacts only if the user wants, and download gravatars