MPOS/php-mpos — pull request #1818 by iAmShorty (2014-02-23 13:37:20+00:00)
Title: [UPDATE] simple robots.txt

checked google for site indexing, there are many links indexing the blocks page and others that i don't like. makes no sense to add those sites to search engine index so i'd like to disallow them with a simple robots.txt.

```
Disallow: /*?page=
```
would only let search spiders indexing the main page, no pages with dynamic content and dynamic urls called with ?page=