Oddly enough - and luckily - you don't. While the For the Hoard trophy text claims you need to obtain all curiosities, that's wrong. You just need the 22 Curiosities that can be displayed on the Wall of Memories. The trophy will pop after you get the last one and check the wall.