zoukankan      html  css  js  c++  java
  • hbase的hue部署和使用

    1.组件版本信息

    zookeeper hadoop hbase     hue          
    zookeeper-3.4.12 hadoop-3.0.3 hbase-2.1.5 4.4.0

    2.hbase的配置  hue关键要添加thrift服务,才能监听9090端口

    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
    <!--
    /**
     *
     * Licensed to the Apache Software Foundation (ASF) under one
     * or more contributor license agreements.  See the NOTICE file
     * distributed with this work for additional information
     * regarding copyright ownership.  The ASF licenses this file
     * to you under the Apache License, Version 2.0 (the
     * "License"); you may not use this file except in compliance
     * with the License.  You may obtain a copy of the License at
     *
     *     http://www.apache.org/licenses/LICENSE-2.0
     *
     * Unless required by applicable law or agreed to in writing, software
     * distributed under the License is distributed on an "AS IS" BASIS,
     * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
     * See the License for the specific language governing permissions and
     * limitations under the License.
     */
    -->
    <configuration>
       <property>
         <name>hbase.rootdir</name>
         <value>hdfs://do1/hbase</value>
       </property>
         <!--启用分布式集群-->
       <property>
         <name>hbase.cluster.distributed</name>
         <value>true</value>
       </property>
          <!--默认HMaster HTTP访问端口-->
         <property>
          <name>hbase.master.info.port</name>
          <value>16010</value>
         </property>
          <!--默认HRegionServer HTTP访问端口-->
        <property>
           <name>hbase.regionserver.info.port</name>
           <value>16030</value>
        </property>
        <property>
          <name>hbase.zookeeper.quorum</name>
          <value>do1cloud01:2181,do1cloud02:2181,do1cloud03:2181</value>
        </property>
       <property>
          <name>hbase.coprocessor.abortonerror</name>
         <value>false</value>
        </property>
        <property>
        <name>hbase.unsafe.stream.capability.enforce</name>
        <value>false</value>
        </property>
        <property>
      <name>hbase.regionserver.thrift.http</name>
      <value>true</value>
    </property>
    <property>
      <name>hbase.thrift.support.proxyuser</name>
      <value>true</value>
    </property>
    <property>
                <name>hadoop.proxyuser.root.hosts</name>
                <value>*</value>
         </property>
        <property>
                <name>hadoop.proxyuser.root.groups</name>
                <value>*</value>
        </property>
     </configuration>

    3.hue的配置

    [desktop]
      http_host=0.0.0.0
      http_port=61111
      time_zone=Asia/Shanghai
      dev=true
      send_dbug_messages=true
      django_email_backend=django.core.mail.backends.console.EmailBackend
      [[django_admins]]
        [[[admin-1]]]
         name=Hue
         email=hue@192.168.1.194.com
      [[custom]]
      [[auth]]
        idle_session_timeout=-1
      [[ldap]]
        [[[users]]]
        [[[groups]]]
        [[[ldap_servers]]]
      [[vcs]]
      [[database]]
      [[session]]
      [[smtp]]
        host=192.168.1.194
        port=25
        user=
        password=
        tls=no
      [[knox]]
      [[kerberos]]
      [[oauth]]
      [[oidc]]
      [[metrics]]
      [[task_server]]
    [notebook]
      [[interpreters]]
    [dashboard]
      [[engines]]
    [hadoop]
      [[hdfs_clusters]]
        [[[default]]]
          fs_defaultfs=hdfs://192.168.1.194:8020
      [[yarn_clusters]]
        [[[default]]]
          submit_to=True
    [beeswax]
    
      [[ssl]]
    [metastore]
    [impala]
      [[ssl]]
    [spark]
    [oozie]
    [filebrowser]
    [pig]
    [sqoop]
    [proxy]
    [hbase]
    hbase_clusters=(Cluster1|192.168.1.194:9090)
    hbase_conf_dir=/do1cloud/hbase-2.1.5/conf
    thrift_transport=buffered
    [search]
    [libsolr]
    [indexer]
    [jobsub]
    [jobbrowser]
    [security]
    [zookeeper]
      [[clusters]]
        [[[default]]]
    [useradmin]
      [[password_policy]]
    [liboozie]
    [aws]
      [[aws_accounts]]
    [azure]
      [[azure_accounts]]
        [[[default]]]
      [[adls_clusters]]
        [[[default]]]
      [[abfs_clusters]]
        [[[default]]]
    [libsentry]
    [libzookeeper]
    [librdbms]
      [[databases]]
    [libsaml]
    [libopenid]
    [liboauth]
    [kafka]
      [[kafka]]
    [metadata]
      [[manager]]
      [[optimizer]]
      [[catalog]]
      [[navigator]]
      [[prometheus]]

     3.hue的配置中关于hbase的配置

    [hbase]
     
      hbase_clusters=(Hbase|127.0.0.1:9090)  #不能用主机名或者localhost,一定要用ip
     
      hbase_conf_dir=/opt/bigdata/hbase/conf
     
      thrift_transport=buffered

    4.非 HBase HA集群的启动方式

    先
    [kfk@master hbase-0.98.6-cdh5.3.0]$ bin/start-hbase.sh 
    再
    [kfk@master hbase-0.98.6-cdh5.3.0]$ bin/hbase-daemon.sh start thrift
    参考:https://www.cnblogs.com/zlslch/p/9195682.html
  • 相关阅读:
    函数式编程之Functional.js源码解析(一)
    libevent的bufferevent
    Luna
    线程池的实现
    如何排查字节对齐问题引起的程序诡异崩溃
    GCC编译之如何控制共享文件导出符号
    ubuntu禁用独显的问题
    protobuf的一些细节
    GCC编译之新老版本共存
    libevent的evbuffer之减少内存拷贝
  • 原文地址:https://www.cnblogs.com/hixiaowei/p/11287579.html
Copyright © 2011-2022 走看看