rich families settled there and built their holiday homes