zoukankan      html  css  js  c++  java
  • centos7集群安装Greenplum6.9.0

    一、环境准备

    安装包:greenplum-db-6.9.0-rhel7-x86_64.rpm

    下载路径:https://github.com/greenplum-db/gpdb/releases

    172.16.43.157    master
    172.16.43.173    segment
    172.16.43.155    segment

    二、基础配置(三台都要做)

    1、关闭防火墙,关闭selinux(略)

    2、配置主机名

    [root@database-zongshuai greenplum]# cat  /etc/hosts
    172.16.43.157 database-zongshuai.novalocal
    172.16.43.173 gdym03-zongshuai.novalocal
    172.16.43.155 gdym02-zongshuai.novalocal

    3、修改内核参数

    [root@database-zongshuai greenplum]# cat  /etc/sysctl.conf 
    vm.swappiness=10
    kernel.shmall = 68719476736
    kernel.shmmax = 4294967296
    kernel.shmmni = 4096
    vm.overcommit_memory = 2 
    vm.overcommit_ratio = 95 
    net.ipv4.ip_local_port_range = 10000 65535 
    kernel.sem = 500 2048000 200 40960
    kernel.sysrq = 1
    kernel.core_uses_pid = 1
    kernel.msgmnb = 65536
    kernel.msgmax = 65536
    kernel.msgmni = 2048
    net.ipv4.tcp_syncookies = 1
    net.ipv4.conf.default.accept_source_route = 0
    net.ipv4.tcp_max_syn_backlog = 4096
    net.ipv4.conf.all.arp_filter = 1
    net.core.netdev_max_backlog = 10000
    net.core.rmem_max = 2097152
    net.core.wmem_max = 2097152
    vm.zone_reclaim_mode = 0
    vm.dirty_expire_centisecs = 500
    vm.dirty_writeback_centisecs = 100
    vm.dirty_background_ratio = 3
    vm.dirty_ratio = 10
    vm.dirty_background_bytes = 1610612736
    vm.dirty_bytes = 4294967296

    4、修改描述符文件

    [root@database-zongshuai greenplum]# cat  /etc/security/limits.conf
    * soft nofile 65536
    * hard nofile 65536
    * soft nproc 131072
    * hard nproc 131072

    三、安装greenplum数据库

    1、rpm安装(master做)

    [root@database-zongshuai greenplum]# rpm -ivh --prefix=/data/greenplum  greenplum-db-6.9.0-rhel7-x86_64.rpm

     2、创建gpadmin用户并授权(三台都要做)

    [root@database-zongshuai greenplum]# groupadd -g 530 gpadmin
    [root@database-zongshuai greenplum]# useradd -g 530 -u 530 -m -d /home/gpadmin -s /bin/bash gpadmin
    [root@database-zongshuai greenplum]# chown -R gpadmin:gpadmin /data/greenplum

    3、应用环境变量

    切换gpadmin用户

    [root@database-zongshuai greenplum]# su - gpadmin
    [gpadmin@database-zongshuai ~]$ source   /data/greenplum/greenplum-db/greenplum_path.sh

    4、 设置gpadmin用户的环境变量

    [gpadmin@database-zongshuai ~]$ cat ~/.bash_profile 
    source   /data/greenplum/greenplum-db/greenplum_path.sh
    export MASTER_DATA_DIRECTORY=/data/greenplum/gpdata/master/gpseg-1
    export PGPORT=5432
    export PGUSER=gpadmin
    export PGDATABASE=gpdb
    [gpadmin@database-zongshuai ~]$ source  ~/.bash_profile

    5、配置免密

    [gpadmin@gdym01-zongshuai ~]$ ssh-keygen  -t rsa
    [gpadmin@gdym01-zongshuai ~]$ ssh-copy-id   gdym02-zongshuai.novalocal
    [gpadmin@gdym01-zongshuai ~]$ ssh-copy-id   gdym03-zongshuai.novalocal
    [gpadmin@gdym01-zongshuai ~]$ ssh-copy-id  database-zongshuai.novalocal

    7、添加节点服务器文件

    [gpadmin@database-zongshuai ~]$ mkdir  conf
    [gpadmin@database-zongshuai ~]$  cd  conf
    [gpadmin@database-zongshuai ~]$  vim  seg_hosts
    gdym03-zongshuai.novalocal
    gdym02-zongshuai.novalocal
    database-zongshuai.novalocal

    8、使用gpssh-exkeys打通所有服务器(Master)

    [gpadmin@database-zongshuai conf]$ gpssh-exkeys -f /home/gpadmin/conf/seg_hosts
    • 在打通所有机器通道之后,我们就可以使用 gpssh 命令对所有机器进行批量操作了。

      [gpadmin@database-zongshuai conf]$ gpssh -f /home/gpadmin/conf/seg_hosts

      优势: 只需要操作一次,就完成到全部集群的操作

    (1)打包

    [gpadmin@database-zongshuai ~]$ cd /data/greenplum/
    [gpadmin@database-zongshuai ~]$ tar -czf  gp6.tar.gz  greenplum-db-6.9.0

    (2)分发(切回gpadmin)

    [gpadmin@database-zongshuai greenplum]$ source /opt/greenplum/greenplum-db/greenplum_path.sh
    [gpadmin@database-zongshuai greenplum]$ gpscp -f /home/gpadmin/conf/seg_hosts  gp6.tar.gz =:/data/greenplum

    (3)解压()

    [gpadmin@database-zongshuai greenplum]$ cd /data/greenplum
    [gpadmin@database-zongshuai greenplum]$ tar -xf gp6.tar.gz
    [gpadmin@database-zongshuai greenplum]$ ln -s greenplum-db-6.9.0 greenplum-db

    (4)创建数据目录

    [gpadmin@database-zongshuai greenplum]$ mkdir -p /data/greenplum/gpdata/master
    [gpadmin@database-zongshuai greenplum]$ gpssh -f /home/gpadmin/conf/seg_hosts
    => mkdir -p /data/greenplum/gpdata/primary
    => mkdir -p /data/greenplum/gpdata/mirror 

     四、初始化数据库

    1、复制配置文件

    [gpadmin@database-zongshuai greenplum]$ cp  /data/greenplum/greenplum-db/docs/cli_help/gpconfigs/gpinitsystem_config   /home/gpadmin/conf/initGreenplum

    2、修改配置文件 /home/gpadmin/conf/initGreenplum

    [gpadmin@database-zongshuai conf]$ grep  ^[a-zA-Z] initGreenplum
    ARRAY_NAME="Greenplum Data Platform"
    SEG_PREFIX=gpseg
    PORT_BASE=6000
    declare -a DATA_DIRECTORY=(/data/greenplum/gpdata/primary)
    MASTER_HOSTNAME=database-zongshuai.novalocal
    MASTER_DIRECTORY=/data/greenplum/gpdata/master
    MASTER_PORT=5432
    TRUSTED_SHELL=ssh
    CHECK_POINT_SEGMENTS=8
    ENCODING=UNICODE
    MIRROR_PORT_BASE=7000
    declare -a MIRROR_DATA_DIRECTORY=(/data/greenplum/gpdata/mirror)
    DATABASE_NAME=gpdb
    MACHINE_LIST_FILE=/home/gpadmin/conf/seg_hosts

    3、运行初始化命令

    [gpadmin@database-zongshuai conf]$ gpinitsystem -c /home/gpadmin/conf/initGreenplum

  • 相关阅读:
    后海日记(8)
    后海日记(8)
    后海日记(7)
    后海日记(7)
    hadoop自己写的最高温度程序源码
    hadoop自己写的最高温度程序源码
    20张图为您讲述磁盘发展史
    20张图为您讲述磁盘发展史
    2017"百度之星"程序设计大赛
    汕头市赛srm1X T3
  • 原文地址:https://www.cnblogs.com/lina-2159/p/15440038.html
Copyright © 2011-2022 走看看