fix robots.txt directives array logic #2797
Merge pull request #3126 from openscholar/2797-hotfix

@hotfix SCHOLAR-3.6 fix robots.txt directives array logic #2797