Changes to comply with Python code standards
Changes project structure to make it more workable and added classes that will become the crawler. Changed logic of static (non web connectivity) class to have less duplicate code from superclass.
Removed redundant variable declarations from top of class
Making a small change to check behaviour of PyCharm when committed outside of it's VCS integration
Getting rid of ambiguous file
Re-adding problematic file
Removing small change from testing of commit
Moved tests to package and changed to use unittest framework.
Added Page Class and test. Committing before testing each of the URLs parsed for correct structure in test.
Check for each parsed URL now working.
Changes to documentation for class.ˆ
Page being parsed correctly for recipe pages.
Program working for a single page scraping recipes.
Added todo as a reminder.
Commit before making changes to crawler depth functionality
Scan now working with depth and children
Scanning now works
Only add the correct URLs to the list
Split out crawler to specific sub-sites