Yes, by placing hot peppers in the bird feeder or anywhere near their primary territory, you can keep them away. That’s because they don’t like the taste of hot peppers.