Do not attempt to list groups unless we can expect to have the rights to do so.