Add some comments. Use getUrlhashCond().

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1226 fc7d47d3-c008-acd5-f51f-d19787b8a02f
Remove the deprecated autocomplete URL picker.

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1227 fc7d47d3-c008-acd5-f51f-d19787b8a02f
make searching for a URL faster - using the "urls" table

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1228 fc7d47d3-c008-acd5-f51f-d19787b8a02f
The previous change was MUCH faster, but it pulled in URLs that did not have any actual results. (Because we saved all 1M top urls, but we only crawl the top 300K.) This version leverages a faster urlhash search to only pull URLs that have results.

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1229 fc7d47d3-c008-acd5-f51f-d19787b8a02f
If no label is specified, return pageData for the most RECENT test for a URL.

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1230 fc7d47d3-c008-acd5-f51f-d19787b8a02f
add getCrawlFromId(). Add $bCrawlid param to archiveLabels() to return array of crawlids (instead of labels). Add $bMysql and $bCsv to dumpCrawl2() to specify just one desired format (to save time).

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1231 fc7d47d3-c008-acd5-f51f-d19787b8a02f
Improve archiveLabelsForUrl to use urlhash so MUCH faster and more accurate (bugs 358 & 359). Make diffRuns used crawlid - much faster (runs.php does infinite scroll almost instantaneously now).

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1232 fc7d47d3-c008-acd5-f51f-d19787b8a02f
add getPage() based on crawlid

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1233 fc7d47d3-c008-acd5-f51f-d19787b8a02f
Make the list of URLs non-wrap.

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1234 fc7d47d3-c008-acd5-f51f-d19787b8a02f
fix bug where we have to decrease the epoch time for latestCrawl().

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1235 fc7d47d3-c008-acd5-f51f-d19787b8a02f
use crawlid fro diffRuns(). Enable flush.

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1236 fc7d47d3-c008-acd5-f51f-d19787b8a02f
better error handling when the requested URL string is not found.

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1237 fc7d47d3-c008-acd5-f51f-d19787b8a02f
better error handling for no results

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1238 fc7d47d3-c008-acd5-f51f-d19787b8a02f
When adding URLs to the "urls" table, make sure to set the urlhash.

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1239 fc7d47d3-c008-acd5-f51f-d19787b8a02f
add a smaller getUrlhashFunc function

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1240 fc7d47d3-c008-acd5-f51f-d19787b8a02f
add log message

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1241 fc7d47d3-c008-acd5-f51f-d19787b8a02f
update new timeAdded field when we add a URL

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1242 fc7d47d3-c008-acd5-f51f-d19787b8a02f
set the new timeAdded field when importing URLs

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1243 fc7d47d3-c008-acd5-f51f-d19787b8a02f
save "crawlid" to the status table

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1244 fc7d47d3-c008-acd5-f51f-d19787b8a02f
add function updateCrawlFromId()

git-svn-id: http://httparchive.googlecode.com/svn/trunk@1245 fc7d47d3-c008-acd5-f51f-d19787b8a02f