Properly load contact flags even when NAT pinging is disabled