implemented functionality to harvest external data