If you are not able to react with custom emojis on Instagram DMs then you probably have not updated the messaging yet on your account. To update it, open Settings >> Update Messaging >> Update to react with custom emojis.