Boats to the island leave from La Rochelle's Vieux Port.
You can leave the island through a boat from the Vieux Port.