These were the remains of a secret boat entrance to the castle through a cave in the cliff!