The man jumped off the cliff to swim across to the island