Base implementation that provides common method for spiders of all kinds