improve crawler, support gzip