Fetch contact groups in the background