suggest http.max-cache-size argument for consistency rather than http-max-cache-size (both work)

git-svn-id: https://svn.nmap.org/nmap@29116 e0a8ed71-7df4-0310-8962-fdc924857419
Hosts that differ only on the 'www' prefix are now treated as being equal. Also added some documentation for httpspider.useheadfornonwebfiles.

git-svn-id: https://svn.nmap.org/nmap@29118 e0a8ed71-7df4-0310-8962-fdc924857419
Patch to address false positive generated when the target's httpd responds with a HTTP 200 for every request. Committing after email exchange with Paulino C.

git-svn-id: https://svn.nmap.org/nmap@29119 e0a8ed71-7df4-0310-8962-fdc924857419
Added category external to http-icloud* scripts


git-svn-id: https://svn.nmap.org/nmap@29120 e0a8ed71-7df4-0310-8962-fdc924857419
Service detection for Couchbase and Membase NoSQL server's web based administrative portal. By default this is on 8091 but can occur on any port.

git-svn-id: https://svn.nmap.org/nmap@29121 e0a8ed71-7df4-0310-8962-fdc924857419
Patch to fix script issue when scanning HTTP servers that return 200 to every request.  This causes the sanity check on line 88 to fail to trigger because the header value Server is nil.

Implemented a check to if the target is returning 200 to all requests.

Also implemented additional logic on line 84 to verify that the Server header value is not nil.  This is just in case we run into another case where a response is 200 but the Server header does not exist. 

git-svn-id: https://svn.nmap.org/nmap@29122 e0a8ed71-7df4-0310-8962-fdc924857419
membase-http-info updated to reflect new server header found in current versions of the Couchbase HTTP admin port. Explanation email sent to list.

git-svn-id: https://svn.nmap.org/nmap@29123 e0a8ed71-7df4-0310-8962-fdc924857419
Added couchbase matchline that does not require a database name.  This is useful when the service response is so large that the database info is pushed outside the capture buffer.  This was added *after* the matchline that captures the dbname if it is present.

Also added space and a ':' to the database name capture character set to allow for when the database is on a windows server.

git-svn-id: https://svn.nmap.org/nmap@29124 e0a8ed71-7df4-0310-8962-fdc924857419
Added Windows 8 to the list of Windows versions we recommend the WinPcap NPF service is started on startup. Our WinPcap installer appears to work fine on Windows 8 and Server 2012 build 8400.

git-svn-id: https://svn.nmap.org/nmap@29125 e0a8ed71-7df4-0310-8962-fdc924857419
Fixes false positive when dealing with web servers returning status 200 for all reqs

git-svn-id: https://svn.nmap.org/nmap@29126 e0a8ed71-7df4-0310-8962-fdc924857419
Fix exception thrown in reverse-index when it is run again a host with no open ports.  

/reverse-index.nse:112: bad argument #1 to 'pairs' (table expected, got nil)


git-svn-id: https://svn.nmap.org/nmap@29127 e0a8ed71-7df4-0310-8962-fdc924857419
Handle exception generated when the spider process hands http-backup-finder a URL that is only a hostname.  When url.parse processes this value on line 107 of http-backup-finder it returns nil for the .path property.

http-backup-finder.nse:107: attempt to index field 'path' (a nil value)
stack traceback:

Addressed this by setting nil .path values to '/'.  Tested with sites with and without backup files.  Verified that duplicate results were not returned.

git-svn-id: https://svn.nmap.org/nmap@29128 e0a8ed71-7df4-0310-8962-fdc924857419
Adds additional debug message when it fails to hint users about what happened. It also adds another check for web servers that return more than one 404 page.

git-svn-id: https://svn.nmap.org/nmap@29130 e0a8ed71-7df4-0310-8962-fdc924857419
Fixes crash when using identify_404() that happened when the status response changes in the second or third request and the return value is the string "<unknown>". 

Previously, the library only checked for nil. Updated it to check the type of the response value and change it to -1 if its not a number to fix crash when passing a string to %d.

git-svn-id: https://svn.nmap.org/nmap@29131 e0a8ed71-7df4-0310-8962-fdc924857419
Adds http-tplink-dir-traversal.nse in the "exploit" and "vuln" category: NSE to exploit a path traversal vulnerability in the web administration panel of several TP-Link routers.

git-svn-id: https://svn.nmap.org/nmap@29132 e0a8ed71-7df4-0310-8962-fdc924857419
Merge branch 'master' into xml-beta