adds curl handling, makes curl the default method of getting urls