Freedom of speech, whether one approves of the content or not, is a fundamental cornerstone of liberty. The people are just as equal in their right to judge the content thereof, and to criticize as well. Using violence as we have seen recently to suppress free speech shows a basic lack of understanding not only the principles of free speech, but it's inherent place in a free society. 
Thus there are few limitations placed on the exercise of free speech, and examples of those have been given in past court rulings where it has come up, one being yelling fire in a crowded theatre.
Shame we have those who would violently suppress such, and attack the very foundation of individual liberty that America has been so blessed to have, and be upheld as a basic right. One doesn't have to agree with the content, but one should have the intelligence to realize just how important that right is. 
But their will always be those who must employ violence, and that is sad.
Mr. Gorsuch is right.