Forced post from CURL can cause some sites not to be included