not used queue in robots parser removed
prepared sitemaps for production