handle duplicate spidered media urls
Merge branch 'master' into RELEASE_20140325