check for string bytesize and skip over 404'ed pages next time