actor and his family were spotted boating and swimming off the coast on the island