A fragment of the Georgian New Town towers above modern houses descending the banks of the Water of Leith.