A basic web crawler that begins from a seed url and crawls urls level by level until a maximum specified depth is reached.Stores crawled urls in a file. Obeys robots.txt. Has basic command line arguments for setting filename, seed url and maximum depth.