Remove users on ignore list from buddy list