Yes, the other person will be notified if you delete an Instagram chat on both sides. They will see a message that says "This message has been unsent" where the chat used to be.