zoukankan      html  css  js  c++  java
  • HBase 默认刷写文件 flush_compact.xml 注释解析

    flush_compact.xml

        <!-- 一个store里面允许存的hfile的个数,超过这个个数会被写到新的一个hfile里面 也即是每个region的每个列族对应的memstore在fulsh为hfile的时候,默认情况下当超过3个hfile的时候就会   
            对这些文件进行合并重写为一个新文件,设置个数越大可以减少触发合并的时间,但是每次合并的时间就会越长 -->  
        <property>  
            <name>hbase.hstore.compactionThreshold</name>  
            <value>3</value>  
            <description>  
                If more than this number of HStoreFiles in any one HStore  
                (one HStoreFile is written per flush of memstore) then a compaction  
                is run to rewrite all HStoreFiles files as one. Larger numbers  
                put off compaction but when it runs, it takes longer to complete.  
            </description>  
        </property>  
        <!-- 每个minor compaction操作的 允许的最大hfile文件上限 -->  
        <property>  
            <name>hbase.hstore.compaction.max</name>  
            <value>10</value>  
            <description>Max number of HStoreFiles to compact per 'minor'  
                compaction.</description>  
        </property>  
    
    
        <!-- regionServer的全局memstore的大小,超过该大小会触发flush到磁盘的操作,默认是堆大小的40%,而且regionserver级别的   
            flush会阻塞客户端读写 -->  
        <property>  
            <name>hbase.regionserver.global.memstore.size</name>  
            <value></value>  
            <description>Maximum size of all memstores in a region server before  
                new  
                updates are blocked and flushes are forced. Defaults to 40% of heap (0.4).  
                Updates are blocked and flushes are forced until size of all  
                memstores  
                in a region server hits  
                hbase.regionserver.global.memstore.size.lower.limit.  
                The default value in this configuration has been intentionally left  
                emtpy in order to  
                honor the old hbase.regionserver.global.memstore.upperLimit property if  
                present.  
            </description>  
        </property>  
            <!-- 内存中的文件在自动刷新之前能够存活的最长时间,默认是1h -->  
        <property>  
            <name>hbase.regionserver.optionalcacheflushinterval</name>  
            <value>3600000</value>  
            <description>  
                Maximum amount of time an edit lives in memory before being automatically  
                flushed.  
                Default 1 hour. Set it to 0 to disable automatic flushing.  
            </description>  
        </property>  
         <!-- 单个region里memstore的缓存大小,超过那么整个HRegion就会flush,默认128M -->  
        <property>  
            <name>hbase.hregion.memstore.flush.size</name>  
            <value>134217728</value>  
            <description>  
                Memstore will be flushed to disk if size of the memstore  
                exceeds this number of bytes. Value is checked by a thread that runs  
                every hbase.server.thread.wakefrequency.  
            </description>  
        </property>  
  • 相关阅读:
    sqlmap从入门到精通-第四章-4-6 MySQL数据库导入与导出攻略
    Python文章索引(持续更新~)
    如何用 Python 绘制玫瑰图等常见疫情图
    《民国奇探》的弹幕有点逗比,用 Python 爬下来看看
    发现了合自己胃口的公众号,但文章太多翻来翻去真麻烦,还好我学了 Python
    潘粤明的《龙岭迷窟》到底怎么样?我用 Python 得出了一些结论!
    Python 分析电影《南方车站的聚会》
    使用 Scrapy 爬取去哪儿网景区信息
    Python 爬虫(二):Requests 库
    Python 爬虫(一):爬虫伪装
  • 原文地址:https://www.cnblogs.com/chenmingjun/p/10504480.html
Copyright © 2011-2022 走看看