zoukankan      html  css  js  c++  java
  • hbase部署经验与坑总结

    1.本地单机部署hbase,想要使用独立zookeeper,不使用自带的

    vim conf/hbase-env.sh

    export HBASE_MANAGES_ZK=false

    设置不使用自带zookeeper,这一步设置完按理说就可以使用独立的zookeeper程序了,但是总是报错:

    Could not start ZK at requested port of 2181.  ZK was started at port: 2182.  Aborting as clients (e.g. shell) will not be able to find this ZK quorum.

    很明显,这是启动自带zookeeper与独立zookeeper冲突了

    很疑惑,明明设置不启动自带zookeeper了,为什么还是去启动了,后来上网查询才知道,把hbase.cluster.distributed设置为false,也就是让hbase以standalone模式运行时,依然会去启动自带的zookeeper

    所以要做如下设置,值为true

    vim conf/hbase-site.xml

    <property>

     <name>hbase.cluster.distributed</name>

    <value>true</value> 

    </property>

    2.idea javaapi 连接本地hbase超时

    hbase-site.xml增加配置

    <property>
    <name>hbase.master.ipc.address</name>
    <value>0.0.0.0</value>
    </property>
    <property>
    <name>hbase.regionserver.ipc.address</name>
    <value>0.0.0.0</value>
    </property>

    3.如下异常

    java.lang.IllegalStateException: The procedure WAL relies on the ability to hsync for proper operation during component failures, but the underlying filesystem does not support doing so. Please check the config value of 'hbase.procedure.store.wal.use.hsync' to set the desired level of robustness and ensure the config value of 'hbase.wal.dir' points to a FileSystem mount that can provide it.

    hbase-site.xml增加配置 

    <property>
    <name>hbase.unsafe.stream.capability.enforce</name>
    <value>false</value>
    </property>

  • 相关阅读:
    Qt之界面数据存储与获取(使用setUserData()和userData())
    UML中关联(Association)、聚合(Aggregation)和合成(Composition)之间的区别
    Entity Framework Model First下改变数据库脚本的生成方式
    keepalive学习
    函数、极限、连续
    C#集合基础与运用
    面向查询服务的参数化查询
    WinDbg 命令手册
    知识管理方法论
    项目管理Project
  • 原文地址:https://www.cnblogs.com/kevin19931015/p/9243230.html
Copyright © 2011-2022 走看看