wrote most of the jgi-crawler just missing the final step