removed restriction to not include redirects in search