Remove the primary key from the pivot table