If you are an accomplished WebMaster or otherwise experienced user, you've probably heard about Server Side Includes. View Commentary 1. And pay lots of it.
Time is the answer.
I'm convinced that if you know all the tricks and do everything right and consistently, there is now too much material on the web for you to count on search engines alone. We made a point NOT TO LINK TO THE PAGE from any web sites. We made a point NOT TO POST IT to any search engines. It is essentially an island in cyberspace, a page in an unprotected directory, with no links in. This experiment was conducted to study signature files, but we learned much about the SearchEngines too.