An 1814 census recorded 3,507 people on the island