The Vatican Council states that clearly. This is your personal opinion. When we discuss liturgical law, you are in the same boat as bishops, clergy, liturgists, or anyone else who states a liking for a particular way or style of worship. People on various levels take liberties to adapt or change the liturgy. Some can be done validly, licitly, or illegally.
Consequences are few.
I restate my intent when responding to your pastor's omission of the Sign of Peace. He is wrong to do so. That he wears a Roman collar and does so merely means he has the power to sow confusion in his parish, to set up his own cafeteria line if you will. Again, this would be your opinion. I would urge you to examine the history of the liturgy before making blanket judgments about meals, Protestants, and the like.