" I'll enjoy the changes without them." There you go.
At times, I too have been very critical of the way downtown has been handled. Used to work down there helping to maintain the place. Would like to see more leadership on the part of the City stating that you are NOT welcome downtown if you are going to trash the place, engage in selfish, obnoxious behavior, and not respect others rights to be there.  Cops have a tough job.
Some of the homeless often get a bad rap by being lumped into the crowd who are harassing others and making it unpleasant to be there. Too bad. I think that is one thing that is impeding more progress on the part of the community toward the "genuine" homeless.
Good luck with your efforts.