functionality to read from url, and some updates