THIS SHIT WORKS FINALLY
Git ignore added
Crawler fully functioning.