modified fixlinks function. separated requestURL and getBot function for use with recursion. beginning recursion function.