The robots.txt exclusion protocol implementation for the Ruby language.