Yes, obtaining backlinks from questionable sources such as gambling or adult entertainment sites can harm SEO performance. It is crucial to focus on obtaining high-quality links from reputable websites.