Assignment 1 of CS6913, a web crawler