Hackish but fixes crawler weirdness with some sites (/lala.php/fdsfds = lala.php); TODO fix this