English: The merchant set the restrictions in robots.txt or not in the store.
Dutch: De verkoper stelt de beperkingen in robots.txt in of niet in de winkel.