It's possible. My reasoning was just that if the URL is unique, it should be enough to fully describe (and so to compare) two documents. But maybe that's too naive. I'll go back to comparing more than one attribute (I won't use the hash approach since you found it to be slower).