zoukankan      html  css  js  c++  java
  • C#用HttpWebRequest通过代理服务器验证后抓取网页内容

    string urlStr = "http://www.domain.com";                             //設定要獲取的地址
    HttpWebRequest hwr = (HttpWebRequest)HttpWebRequest.Create(urlStr);     //建立HttpWebRequest對象
    hwr.Timeout = 60000;                                                 //定義服務器超時時間
    WebProxy proxy = new WebProxy();                                     //定義一個網關對象
    proxy.Address = new Uri("http://proxy.domain.com:3128");             //網關服務器:端口
    proxy.Credentials = new NetworkCredential("f3210316", "6978233");     //用戶名,密碼
    hwr.UseDefaultCredentials = true;                                     //啟用網關認証
    hwr.Proxy = proxy;                                                     //設置網關
    HttpWebResponse hwrs = (HttpWebResponse)hwr.GetResponse();             //取得回應
    Stream s = hwrs.GetResponseStream();                                 //得到回應的流對象
    StreamReader sr = new StreamReader(s, Encoding.UTF8);                 //以UTF-8編碼讀取流
    StringBuilder content = new StringBuilder();                         //
    while (sr.Peek() != -1)                                                 //每次讀取一行,直到
    {                                                                     //下一個字節沒有內容
         content.Append(sr.ReadLine()+"\r\n");                             //返回為止
    }                                                                     //

    return content.ToString() ;    

                                             //返回得到的字符串

  • 相关阅读:
    oracle 中增加、修改、删除字段
    Oracle 中int , number的区别
    [转]信息系统项目管理师考试论文写作技巧
    项目论证
    java中异步计算之Future
    vmstat例子
    页面重构工作者的必备素质,转载
    办公室人员对号入座太经典啦!
    大家多注意身体!
    经典!牛人汽车防盗秘笈
  • 原文地址:https://www.cnblogs.com/gyxdbk/p/1683716.html
Copyright © 2011-2022 走看看