It happens because either you have added them as a friend or they added you back as a friend. But you can easily remove someone from recent on Snapchat.