Select the person whose Memories you want to change. Tap on the three dots at the top right. You'll get a pop-up menu that lets you, among other things, feature that person less or remove them from the “People” list entirely.