Updates spider doc string and adds comments where code needs to be refactored.