zoukankan      html  css  js  c++  java
  • Multibyte VS WideChar Conversion

    1. Multibyte shows to us as char*. While in fact, it can be any code page encoding, including gbk, utf8, etc. If a char* represents utf8 characters, we need to handle it specially in below way:

    // Convert unicode(windows default utf16) to utf8 char* string.

    MakeUTF8String(const wchar_t* pWide)

    {
        // Compute the required size of the buffer by passing cbMultiByte as 0
        MCAD_ASSERT(pWide);
        int nBytes = ::WideCharToMultiByte(CP_UTF8, 0, pWide, -1, NULL, 0, NULL, NULL);
        MCAD_ASSERT(nBytes > 0);

        char* pNarrow = new char[nBytes + 1];
        nBytes = ::WideCharToMultiByte(CP_UTF8, 0, pWide, -1, pNarrow, nBytes + 1, NULL, NULL);
        UTxString8 utf8Str(pNarrow);
        MCAD_ASSERT(nBytes);
        delete [] pNarrow;
        return utf8Str;

    }

    // Convert a utf8 char* to be utf16 unicode string wchar*.

    MakeWideString(const char* pNarrow)
    {
         // Get the required size of the buffer that receives the Unicode string.
        DWORD dwMinSize;
        dwMinSize = MultiByteToWideChar (CP_UTF8, 0, pNarrow, -1, NULL, 0);

        // Convert headers from ASCII to Unicode.
        wchar* pWide = new wchar[nBytes + 1];
        MultiByteToWideChar (CP_UTF8, 0, pNarrow, -1, pWide, dwMinSize);

        // Below method can work as      above code section:
        // setlocale(LC_ALL, ".65001/.UTF8"); // utf8
        // mbstowcs     
    }

     

    2. My hot summary of WideCharToMultiByte() vs. wcstombs() kind comparison:

    1) wcstombs() calls WideCharToMultiByte() inside.  WideCharToMultiByte() is the basic function to do the conversion. But because of its too many too detail arguments, CRT provides the instead function to ease our work. Very good consideration!

    2) When call WideCharToMultiByte(), there is an argument by which we can set the code page to be used to do the conversion. While for wcstombs(), it just use current system locale. So in order to use these 2 functions really in the same place, Setlocale must be called before wcstombs().

    Resource related:

    wcstombs和mbstowcs

    MultiByteToWideChar

    http://msdn.microsoft.com/en-us/library/ms776413(VS.85).aspx

    Note: For UTF-8, dwFlags must be set to either 0 or MB_ERR_INVALID_CHARS. Otherwise, the function fails with ERROR_INVALID_FLAGS.

    mbstowcs

    http://msdn.microsoft.com/en-us/library/k1f9b8cy(VS.71).aspx

  • 相关阅读:
    ConcurrentHashMap get方法保持同步的解释
    HashMap resize导致死循环
    ConcurrentHashMap原理详解
    单列索引和联合索引区别
    优先队列
    大根堆排序
    小根堆排序
    基础哈夫曼树-最简单的
    二叉查找树
    二叉查找树
  • 原文地址:https://www.cnblogs.com/taoxu0903/p/1282433.html
Copyright © 2011-2022 走看看