fix for some sites throwing errors with normal user agents