Adultery and infidelity have some differences based on the involvement of the partners. In an adultery relationship, people are involved in physical and sexual activity, while infidelity can be physical or simply mental. Besides, adultery is considered a criminal offence, while infidelity is not.