zoukankan      html  css  js  c++  java
  • StreamWriter结合UTF-8编码使用不当,会造成BOM(Byte Order Mark )问题生成乱码(转载)

    问:


    I was using HttpWebRequest to try a rest api in ASP.NET Core MVC.
    Here is my HttpWebRequest client code:

    HttpWebRequest req = (HttpWebRequest)WebRequest.Create("http://localhost:55161/Home/Testing");
    
    string data;
    HttpWebResponse resp = (HttpWebResponse)req.GetResponse();
    using (StreamReader reader = new StreamReader(resp.GetResponseStream(), System.Text.Encoding.UTF8))
    {
        data = reader.ReadToEnd();
    }

    If I used StreamWriter to write a message to Response.Body in an ASP.NET Core controller, everything is fine:

    using (var streamWriter = new StreamWriter(Response.Body, System.Text.Encoding.UTF8))
    {
        streamWriter.Write("hello");
        streamWriter.Flush();
    }

    But if I used Response.Body.Write embedded in a StreamWriter block to write the same message, there will be a weird 65279 character in the end of the string "hello" when I got it from my client code.

    using (var streamWriter = new StreamWriter(Response.Body, System.Text.Encoding.UTF8))
    {
        byte[] data = System.Text.Encoding.UTF8.GetBytes("hello");
        Response.Body.Write(data, 0, data.Length);
    }

    I want to know if this is a bug or any mechanism caused this problem?
    I didn't use UseBrowserLink in startup and my ASP.NET Core version is 2.1

    答:


    there will be a weird 65279 character in the end of the string "hello" when I got it from my client code

    You mean something like this?

    hello

    This is expected based on the code you provided. Why are you wrapping the stream in a StreamWriter, then writing to the stream directly?

    The StreamWriter has a buffer that it will flush to the output when you close it. This will cause a lot of problems if you've been writing to the stream directly. Specifically, what's happening here is this:

    1. You wrap the Stream in the StreamWriter
    2. You write hello directly to the stream
    3. The StreamWriter is closed, so it flushes it's (empty) buffer.
    4. Since you are using the Encoding.UTF8 encoding, the StreamWriter writes a UTF-8 Byte Order Mark (the sequence 0xEF 0xBB 0xBF which appears as  unless it's at the very beginning of the stream) to the stream. Since you've already written hello, this appears after your hello, causing the rendering glitch above.

    因此我们可以看到,在使用StreamWriter的时候,千万不要又用代码直接往StreamWriter底层的Stream对象(本例中是Response.Body)写入数据,因为这很有可能会导致StreamWriter错误地将UTF-8编码的BOM(Byte Order Mark)加到了你写入数据的后面,而UTF-8编码的BOM(Byte Order Mark)只能够出现在一个Stream最开头才能被正确地识别,否则会被识别为乱码,如同本例中的hello一样。

    原文链接

  • 相关阅读:
    zbb20180930 设计模式-单例模式
    zbb20180930 代理模式 -静态代理-jdk动态代理-cglib动态代理
    zbb20180929 thread java并发编程之Condition
    zbb20180929 thread 自旋锁、阻塞锁、可重入锁、悲观锁、乐观锁、读写锁、对象锁和类锁
    zbb20180929 thread notify()与notifyAll()的区别
    26、Jquery 基础
    25、Javascript 事件
    24、Javascript BOM
    23、Javascript DOM
    22、正则表达式
  • 原文地址:https://www.cnblogs.com/OpenCoder/p/10831281.html
Copyright © 2011-2022 走看看