filterAttributes option allows custom filtering of the attributes of documents to discover URLs or just look at what's going on