Properly load contact flags even when NAT pinging is disabled
(cherry picked from commit 39119d1dadb09f3d0999023e41736548a0e446aa)