Added filtering of crawlers from display based upon user agent