try to improve performance by using wget/curl whenever possible (forking a new thread made application crash due to the LWP::Simple module not supporting forking)