Cloudflare generally throws this error when it thinks the IP is either malicious or trying to scrape data from the website. This error is typically shown as Access Denied message and can occur for a variety of reasons, such as using a VPN, Tor, or accessing the website from a blacklisted IP address. This error could be frustrating if you are trying to scrape a website at scale. There are three solutions to this problem.
1. You can use residential proxies to scrape the website. Residential proxies are real device IPs through which you can bypass the on-site protection of any website.
2. The second solution to this problem would be to use headless Chrome browsers along with residential proxies.
3. If you want to avoid managing a browser and a proxy then you should go for Scrapingdog. Scrapingdog will handle all the hassles so that you can collect data without getting blocked.