Non-compliance can result in fines, back taxes, and potential legal issues in the host country. Businesses may face penalties for failing to register a PE, file tax returns, or comply with local transfer pricing regulations.