Following the river south from the harbour, past a staggering number of imposing old churches (many now defunct), the city seems to peel away and a real sense of the Highlands sets in as the trees crowd around us.