update spider to correctly handle query strings