我正在编写一个使用 C# Windows 窗体读取网页内容的程序。我正在使用HttpWebRequest和WebResponse阅读任何内容都没问题。但是页面访问者计数器受此影响并且正在上升。我不想增加访客柜台。我使用UserAgent
信息"Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
,但它不能解决我的问题。在不影响访问者计数器网页的情况下,如何解决此问题。我很抱歉我的小英语,请帮助我。
我的代码是这样的:
HttpWebRequest wReq = (HttpWebRequest)WebRequest.Create(url);
wReq.Method = "GET"; // Alredy use a POST
wReq.MediaType = "HTTP/1.1";
wReq.ContentType = "text/xml";
wReq.Referer = "http://googlebot.com/"; // Already use site name
wReq.UserAgent = "Googlebot/2.1 (+http://www.googlebot.com/bot.html)";
wReq.CookieContainer = new CookieContainer();
wReq.Timeout = 10000;
WebResponse wRes = wReq.GetResponse();
Encoding enc = Encoding.GetEncoding("iso-8859-9");
StreamReader sRed = new StreamReader(wRes.GetResponseStream(), enc);
return sRed.ReadToEnd();