Updated spider; added better documentation