Using gzip: YES HTTP_ACCEPT_ENCODING = gzip HTTP_USER_AGENT = CCBot/1.0 (+http://www.commoncrawl.org/bot.html)