extended documentation on how to access crawler stats from extensions
better backwards compatibility for scrapy.conf.settings

Althought this backwards compatibility is more complex, it avoid modules
from failing when importing scrapy.conf, if they are not run through
"scrapy" command (such as when running tests on scrapy projects code).
fixed LogStats extension, which got broken after a wrong merge before the 0.16 release
update news file with 0.16.1 release notes
proper unittest-like output for scrapy contracts
scrapy contracts verbose option
scrapy contracts: python2.6 compat
Fix SpiderState bug in Windows platforms

The spider state file was not opened in binary mode.
removed reference to global scrapy stats from settings doc
added open_in_browser to debugging doc
Add xpath suppot for FormRequest.from_response.
Merge pull request #177 from alexcepoi/contracts_fixes

Improve feedback on spider contracts run
added 0.18 to release notes and mention spider contracts
Add 0.16.2 release notes

Conflicts:

	docs/news.rst
Fixed docs typo in SpiderOpenCloseLogging example
Merge pull request #189 from coagulant/patch-1

Fixed docs typo in SpiderOpenCloseLogging example
The Link object has a 'nofollow' attribute. Adding support in the SGML link extractors.
Merge pull request #190 from pedrofaustino/master

Adding support to 'nofollow' in the SGML link extractors
Fix broken doc links.

All generated template files contain broken link to doc files.
Merge pull request #192 from vkrest/master

Fix broken doc links.