SAP ERP and Oracle RDBMS differ primarily in their core functionalities; SAP focuses on integrated business process management, while Oracle RDBMS excels in database management and scalability, catering to different business needs.