Fix possible assertions when no connections ar set up