added protection to not query diffbot redundantly