Also make sure we delete M2M relations.