Only count the user's last vote