allows simple yet efficient web crawling from the command line with easy extension with further tools