Only set fixed_ip when we know it