Lets Code : EP 1 : Web Scraping
Channel: Hillbilly Storytime
Date: 2018-05-08

In this video, I step through my process of creating a web scraping python script.  I start with a basic script and keep adding features to it until I have a fairly robust script that I could easily customize to perform most any web scraping task I would need.

The full code can be found at https://github.com/tatanus/Python4Pentesters/blob/master/webscraper/webscraper_beautifulsoup.py

I borrowed some code snippets and ideas from this article:  https://towardsdatascience.com/5-strategies-to-write-unblock-able-web-scrapers-in-python-5e40c147bdaf

Playlist ► https://www.youtube.com/playlist?list=PLAM3fSZVpRYXBi8ymIFNStA6pQEAYWv65

----------------------------------------------------------------------------------------

Leave a LIKE if you enjoyed today's video!
Please SUBSCRIBE if you wish to be notified of new videos when they come out.

----------------------------------------------------------------------------------------

Links:
● Twitter https://twitter.com/tatanus
● Twitter (alt) http://twitter.com/pentestlessons
● Website http://www.hillbillstorytime.com
● Patreon https://www.patreon.com/HillbillyStorytime

All Playlists:
● Tool Demos https://www.youtube.com/playlist?list=PLAM3fSZVpRYXdnOcjh4q2OGiGpgXE7MMz
● Programming for Pentesters https://www.youtube.com/playlist?list=PLAM3fSZVpRYXBi8ymIFNStA6pQEAYWv65
● Pentest Fails https://www.youtube.com/playlist?list=PLAM3fSZVpRYUPR4fF6wf0hm37_hwe9-Rq
● Conference Presentations https://www.youtube.com/playlist?list=PLAM3fSZVpRYW0d3jW_QySs1NAuw3uCL57

----------------------------------------------------------------------------------------