fix #1058 by setting noscript properly

If the tiddlers.link is to the recipe for the current space
then set noscript to /tiddlers, otherwise let it be what it
would have been otherwise.
Adjust the default robots.txt

The new rules say:

Don't index anything in and below /bags and /recipes

This means that what google will index is the "friendly" stuff
that is found at /: / itself, /tiddlers and /<friendly_uris>.

This is a precursor to fixing the html on tiddlyspace. See:

   http://cdent.tiddlyspace.com/Fixing%20TiddlySpace%20HTML
release 1.2.10

* more restricted robots.txt
* better noscript link in tiddlywiki
Fix for #1064

the tiddlyspace directory seemed the most appropriate place for it
Merge pull request #1065 from colmjude/master

Fix for #1064
ensured dependencies are only re-downloaded if outdated

thus reducing the time it takes to set up a dev instance

via
http://www.oddmuse.org/cgi-bin/oddmuse/Download_Using_Curl_And_Caching

note, however, that neither `wrap_jslib` nor the Python-based retrieval
(via `ibuilder`) currently take advantage of caching
Merge pull request #1067 from FND/depcache

ensured dependencies are only re-downloaded if outdated
Merge branch 'master' into betatiddlywiki

Conflicts:
	Makefile

Corrected to deal with change in curl downloads.
Allow an externalized non-beta tiddlywiki

The tiddlywiki build process now creates the necessary
files for both.