It is all about your preference. I like to try and find them while in the palace because I look for everything on my way to the treasure. Mementos you are not on a timeline and can explore at your leisure. Watch out for Reapers out there.