By 1651, the Dutch had mainly abandoned the island in favour of their colony at the Cape of Good Hope