multi-functional web crawler in java