You can temporarily turn off the app completely by going to Settings page within the app at Shopify Admin and choose Disable and click Submit. This will ensure Make an Offer feature will not be displayed in any page of your store. When you Enable it back, all your configurations, content and settings will be back online instantly.