The two ports are quite close, so you can simply walk about 200 meters to the left (facing the island) toward the Maschio castle.