functions as a web crawler now, more exception handling and content storing needed