Completing all the Ostraka's does not give trophies or achievements, so you do not need to worry about completing all, but you can complete the riddle that provides the engraving you want for your armor.