Remove vote relation on User model