use program
Update README.md
refactoring crawler class and thinking about effective shutdown
Merge branch 'dev' of github.com:SerjNarbut/webcrawler into dev
Merge pull request #1 from SerjNarbut/dev

Dev