zoukankan      html  css  js  c++  java
  • StreamWriter结合UTF-8编码使用不当,会造成BOM(Byte Order Mark )问题生成乱码(转载)

    问:


    I was using HttpWebRequest to try a rest api in ASP.NET Core MVC.
    Here is my HttpWebRequest client code:

    HttpWebRequest req = (HttpWebRequest)WebRequest.Create("http://localhost:55161/Home/Testing");
    
    string data;
    HttpWebResponse resp = (HttpWebResponse)req.GetResponse();
    using (StreamReader reader = new StreamReader(resp.GetResponseStream(), System.Text.Encoding.UTF8))
    {
        data = reader.ReadToEnd();
    }

    If I used StreamWriter to write a message to Response.Body in an ASP.NET Core controller, everything is fine:

    using (var streamWriter = new StreamWriter(Response.Body, System.Text.Encoding.UTF8))
    {
        streamWriter.Write("hello");
        streamWriter.Flush();
    }

    But if I used Response.Body.Write embedded in a StreamWriter block to write the same message, there will be a weird 65279 character in the end of the string "hello" when I got it from my client code.

    using (var streamWriter = new StreamWriter(Response.Body, System.Text.Encoding.UTF8))
    {
        byte[] data = System.Text.Encoding.UTF8.GetBytes("hello");
        Response.Body.Write(data, 0, data.Length);
    }

    I want to know if this is a bug or any mechanism caused this problem?
    I didn't use UseBrowserLink in startup and my ASP.NET Core version is 2.1

    答:


    there will be a weird 65279 character in the end of the string "hello" when I got it from my client code

    You mean something like this?

    hello

    This is expected based on the code you provided. Why are you wrapping the stream in a StreamWriter, then writing to the stream directly?

    The StreamWriter has a buffer that it will flush to the output when you close it. This will cause a lot of problems if you've been writing to the stream directly. Specifically, what's happening here is this:

    1. You wrap the Stream in the StreamWriter
    2. You write hello directly to the stream
    3. The StreamWriter is closed, so it flushes it's (empty) buffer.
    4. Since you are using the Encoding.UTF8 encoding, the StreamWriter writes a UTF-8 Byte Order Mark (the sequence 0xEF 0xBB 0xBF which appears as  unless it's at the very beginning of the stream) to the stream. Since you've already written hello, this appears after your hello, causing the rendering glitch above.

    因此我们可以看到,在使用StreamWriter的时候,千万不要又用代码直接往StreamWriter底层的Stream对象(本例中是Response.Body)写入数据,因为这很有可能会导致StreamWriter错误地将UTF-8编码的BOM(Byte Order Mark)加到了你写入数据的后面,而UTF-8编码的BOM(Byte Order Mark)只能够出现在一个Stream最开头才能被正确地识别,否则会被识别为乱码,如同本例中的hello一样。

    原文链接

  • 相关阅读:
    使用工具创建Ribbon的按钮
    【20160924】GOCVHelper 图像增强部分(1)
    Xamarin Essentials教程语音播报TextToSpeech
    Xamarin Essentials教程发送邮件Email
    Xamarin SQLite教程数据库访问与生成
    XamarinEssentials教程应用程序信息AppInfo
    XamarinAndroid组件教程RecylerView自定义适配器动画
    Xamarin Essentials教程安全存储SecureStorage
    Xamarin Essentials应用教程文件系统FileSystem
    XamarinAndroid组件教程RecylerView适配器设置动画示例
  • 原文地址:https://www.cnblogs.com/OpenCoder/p/10831281.html
Copyright © 2011-2022 走看看