The coastal areas of the island were controlled by the Portuguese in the 16th century and by the Dutch in the 17th century .