3.0

I added support for robots.txt files for each site as per our e-mail chain earlier this afternoon. Most of the code I got from elsewhere within the module so it wasn't to difficult.