The reason why you can't access the islands with Solstice Shrines on them is by design. You can only access these ahead of the final battle when you gain the power to fly freely around the map.