Don't remove votes on client disconnect