Fixed crash where listen_to_all wasn't initialized
Special cases for affinity zero