Remove upvoters/downvoters from data model