zoukankan      html  css  js  c++  java
  • OGG到kafka替换目标端OGG

    1.--源端 

    --停源端所有进程

    stop *

    stop mgr

    2.--目标端进程

    info REP_K4 showch---看RBA是否变化,查询checkpoint 表

    send REP_K4 status--查看 有没有大事物

    --确认上述信息OK,则停目标端所有进程

    stop *

    stop mgr

    3.----新目标端

    备份之前安装的软件

    cd /data/ogg

    mkdir bak

    ls 

    bak  ggs12

    cd ggs12

    mv * ./../bak

    cd /data/ogg

    rm -rf ggs12

    ---目标库

    [root@OGG-CLIENT ogg]# mkdir bak

    [root@OGG-CLIENT ogg]# cd ggs12/

    [root@OGG-CLIENT ggs12]# mv * ./../bak/

    [root@OGG-CLIENT ggs12]# ls

    4.---旧目标端,将全部信息传递到新的目标段

    scp -r ggs12/ app@1.3.10.11:/data/ogg

    5.启动所有进程

    drwxr-x--- 2 app app  206 Jul  5 17:52 dirchk

    drwxr-x--- 2 app app    6 Jul  2 20:23 dircrd--空

    drwxr-x--- 2 app app 4096 Aug 20 22:15 dirdat

    drwxr-x--- 2 app app 4096 Aug 20 20:52 dirdef

    drwxr-x--- 2 app app  108 Jul 23 19:35 dirdmp

    drwxr-x--- 4 app app   38 Aug 29  2017 diretc

    drwxr-x--- 2 app app   24 Aug 29  2017 dirout

    drwxr-x--- 2 app app  121 Aug 20 20:53 dirpcs

    drwxr-x--- 2 app app  326 Jul 23 19:49 dirprm

    drwxr-x--- 2 app app 8192 Aug 20 20:53 dirrpt

    drwxr-x--- 2 app app    6 Jul  2 20:23 dirsql--空

    drwxr-x--- 2 app app    6 Aug 20 20:53 dirtmp--空

    drwxr-x--- 2 app app    6 Jul  2 20:23 dirwlt--空

    drwxr-x--- 5 app app   46 Aug 29  2017 dirwww

    ---报错

    2019-08-20 23:31:23  ERROR   OGG-01091  Unable to open file "/data/ggs12/dirdat/t1002322" (error 2, No such file or directory).

    cd /data/ogg/ggs12/dirdat

    [app@OGG-CLIENT dirdat]$ ll t1002322

    cd /data/ogg/ggs12

    ./ggsci

    stop mgr

    [app@OGG-CLIENT data]$ ps -ef|grep mgr

    app       96817      1  0 23:30 ?        00:00:00 ./mgr PARAMFILE /data/ogg/ggs12/dirprm/mgr.prm REPORTFILE /data/ogg/ggs12/dirrpt/MGR.rpt PROCESSID MGR

    app       97030  96606  0 23:35 pts/0    00:00:00 grep --color=auto mgr

    [app@OGG-CLIENT data]$ kill -9 96817

    [app@OGG-CLIENT data]$ cd ggs12/

    [app@OGG-CLIENT ggs12]$ ./ggsci 

    [app@OGG-CLIENT ogg]$ mv ggs12/ ./..

    ---再次报错

    [app@OGG-CLIENT ggs12]$ ./ggsci 

    Oracle GoldenGate for Big Data

    Version 12.3.1.1.1

    Oracle GoldenGate Command Interpreter

    Version 12.3.0.1.0 OGGCORE_OGGADP.12.3.0.1.0GA_PLATFORMS_170828.1608

    Linux, x64, 64bit (optimized), Generic on Aug 28 2017 17:13:45

    Operating system character set identified as UTF-8.

    Copyright (C) 1995, 2017, Oracle and/or its affiliates. All rights reserved.

    Source Context :

      SourceModule            : [ggparam.repo]

      SourceID                : [/scratch/aime/adestore/views/aime_adc4150324/oggcore/OpenSys/src/gglib/ggparam/paramrepo.cpp]

      SourceMethod            : [open_specfile]

      SourceLine              : [1221]

      ThreadBacktrace         : [15] elements

                              : [/data/ggs12/libgglog.so(CMessageContext::AddThreadContext()+0x1e) [0x7fc673a2e54e]]

                              : [/data/ggs12/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...)+0x6ac) [0x7fc673a1ed4c]]

                              : [/data/ggs12/libgglog.so(_MSG_String_Int32_String(CSourceContext*, int, char const*, int, char const*, CMessageFactory::MessageDisposition)+0x4a) [0x7fc673a1226a]]

                              : [/data/ggs12/libggparam.so(ggs::ggparam::repo::open_specfile(char const*)+0x2f0) [0x7fc671b833b0]]

                              : [/data/ggs12/libggparam.so(ggs::ggparam::repo::open()+0x51) [0x7fc671b849e1]]

                              : [/data/ggs12/libggparam.so(ggs::ggparam::dict::dict()+0x104) [0x7fc671b8ccf4]]

                              : [/data/ggs12/libggparam.so(ggs::ggparam::dict::instance()+0x43) [0x7fc671b8cea3]]

                              : [./ggsci(readGlobalConfigFile()+0x59) [0x54b929]]

                              : [./ggsci() [0x62cecb]]

                              : [./ggsci(ggs::gglib::MultiThreading::MainThread::ExecMain()+0x5e) [0x5550de]]

                              : [./ggsci(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::ThreadArgs*)+0x173) [0x5594a3]]

                              : [./ggsci(ggs::gglib::MultiThreading::MainThread::Run(int, char**)+0x140) [0x559d10]]

                              : [./ggsci(main+0x3b) [0x64c1cb]]

                              : [/lib64/libc.so.6(__libc_start_main+0xf5) [0x7fc66d119445]]

                              : [./ggsci(__gxx_personality_v0+0x299) [0x4b6529]]

    2019-08-20 23:38:14  ERROR   OGG-10111  Error opening parameter definition file: /data/ogg/ggs12/ggparam.dat.

    errno: 2 - No such file or directory.

    2019-08-20 23:38:14  WARNING OGG-01525  Failed to open trace output file, '/data/ogg/ggs12/dirdmp/gglog-ggsci.dmp', error 2 (No such file or directory).

    2019-08-20 23:38:14  ERROR   OGG-01668  PROCESS ABENDING.

    [app@OGG-CLIENT ggs12]$ cd 

    [app@OGG-CLIENT ~]$ vi .bash_profile 

    [app@OGG-CLIENT ~]$ export OGG_HOME=

    [app@OGG-CLIENT ~]$ cd /data/ggs12/

    [app@OGG-CLIENT ggs12]$ ./ggsci 

    Oracle GoldenGate for Big Data

    Version 12.3.1.1.1

    Oracle GoldenGate Command Interpreter

    Version 12.3.0.1.0 OGGCORE_OGGADP.12.3.0.1.0GA_PLATFORMS_170828.1608

    Linux, x64, 64bit (optimized), Generic on Aug 28 2017 17:13:45

    Operating system character set identified as UTF-8.

    Copyright (C) 1995, 2017, Oracle and/or its affiliates. All rights reserved.

    GGSCI (OGG-CLIENT) 1> info all

    Program     Status      Group       Lag at Chkpt  Time Since Chkpt

    MANAGER     STOPPED                                           

    REPLICAT    ABENDED     REP_K1    00:00:00      01:07:47    

    REPLICAT    ABENDED     REP_K2    00:00:00      01:07:47    

    REPLICAT    ABENDED     REP_K3    00:00:00      01:07:46    

    REPLICAT    ABENDED     REP_K4    00:00:00      01:07:45    

    REPLICAT    ABENDED     REP_K5    00:00:00      01:07:45    

    GGSCI (OGG-CLIENT) 2> start mgr

    Manager started.

    GGSCI (OGG-CLIENT) 3> info mgr

    Manager is running (IP port OGG-CLIENT.8909, Process ID 97094).

    GGSCI (OGG-CLIENT) 4> info all

    Program     Status      Group       Lag at Chkpt  Time Since Chkpt

    MANAGER     RUNNING                                           

    REPLICAT    ABENDED     REP_K1    00:00:00      01:07:56    

    REPLICAT    ABENDED     REP_K2    00:00:00      01:07:56    

    REPLICAT    ABENDED     REP_K3    00:00:00      01:07:55    

    REPLICAT    ABENDED     REP_K4    00:00:00      01:07:54    

    REPLICAT    ABENDED     REP_K5    00:00:00      01:07:53    

    GGSCI (OGG-CLIENT) 5> start REP_K1

    Sending START request to MANAGER ...

    REPLICAT REP_K1 starting

    GGSCI (OGG-CLIENT) 6> info REP_K1

    REPLICAT   REP_K1  Last Started 2019-08-20 23:41   Status RUNNING

    Checkpoint Lag       00:00:00 (updated 01:08:03 ago)

    Process ID           97103

    Log Read Checkpoint  File /data/ggs12/dirdat/t1002322

                         First Record  RBA 49652169

    GGSCI (OGG-CLIENT) 7> !

    info REP_K1

    REPLICAT   REP_K1  Last Started 2019-08-20 23:41   Status RUNNING

    Checkpoint Lag       01:11:06 (updated 00:00:00 ago)

    Process ID           97103

    Log Read Checkpoint  File /data/ggs12/dirdat/t1002324

                         2019-08-20 22:30:41.200193  RBA 8347811

    [app@OGG-CLIENT ~]$ vi .bash_profile 

    [app@OGG-CLIENT ~]$ cat .bash_profile 

    # .bash_profile

    # Get the aliases and functions

    if [ -f ~/.bashrc ]; then

    . ~/.bashrc

    fi

    # User specific environment and startup programs

    #export OGG_HOME=/data/ogg/ggs12

    export OGG_HOME=/data/ggs12

    JAVA_HOME="/home/app/jdk1.8.0_101"

    CLASSPATH="$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib"

    NODE_HOME="/home/app/node-v8.11.2-linux-x64"

    PATH=$PATH:$HOME/.local/bin:$HOME/bin:$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$NODE_HOME/bin

    export LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/amd64:$JAVA_HOME/jre/lib/amd64/libjsig.so:$JAVA_HOME/jre/lib/amd64/server:$JAVA_HOME/jre/lib/amd64/server/libjvm.so:$LD_LIBRARY_PATH

    stty erase ^h

    export PATH

    [app@OGG-CLIENT ~]$ source .bash_profile

    [app@OGG-CLIENT ~]$ cd /data/ggs12/

    ogg for kafka 平滑过渡方案落地   注意:原目标端ogg目录是啥,到目标端 ogg目录还得一致。

    1.--源端 
    --停源端所有进程stop *stop mgr
    2.--目标端进程info REP_K4 showch---看RBA是否变化,查询checkpoint 表send REP_K4 status--查看 有没有大事物
    --确认上述信息OK,则停目标端所有进程stop *stop mgr

    3.----新目标端备份之前安装的软件cd /data/oggmkdir bak
    ls bak  ggs12
    cd ggs12mv * ./../bak
    cd /data/oggrm -rf ggs12

    ---目标库[root@OGG-CLIENT ogg]# mkdir bak[root@OGG-CLIENT ogg]# cd ggs12/[root@OGG-CLIENT ggs12]# mv * ./../bak/[root@OGG-CLIENT ggs12]# ls

    4.---旧目标端,将全部信息传递到新的目标段scp -r ggs12/ app@10.3.120.151:/data/ogg

    5.启动所有进程


    drwxr-x--- 2 app app  206 Jul  5 17:52 dirchkdrwxr-x--- 2 app app    6 Jul  2 20:23 dircrd--空drwxr-x--- 2 app app 4096 Aug 20 22:15 dirdatdrwxr-x--- 2 app app 4096 Aug 20 20:52 dirdefdrwxr-x--- 2 app app  108 Jul 23 19:35 dirdmpdrwxr-x--- 4 app app   38 Aug 29  2017 diretcdrwxr-x--- 2 app app   24 Aug 29  2017 diroutdrwxr-x--- 2 app app  121 Aug 20 20:53 dirpcsdrwxr-x--- 2 app app  326 Jul 23 19:49 dirprmdrwxr-x--- 2 app app 8192 Aug 20 20:53 dirrptdrwxr-x--- 2 app app    6 Jul  2 20:23 dirsql--空drwxr-x--- 2 app app    6 Aug 20 20:53 dirtmp--空drwxr-x--- 2 app app    6 Jul  2 20:23 dirwlt--空drwxr-x--- 5 app app   46 Aug 29  2017 dirwww


    ---报错2019-08-20 23:31:23  ERROR   OGG-01091  Unable to open file "/data/ggs12/dirdat/t1002322" (error 2, No such file or directory).
    cd /data/ogg/ggs12/dirdat[app@OGG-CLIENT dirdat]$ ll t1002322
    cd /data/ogg/ggs12./ggscistop mgr
    [app@OGG-CLIENT data]$ ps -ef|grep mgrapp       96817      1  0 23:30 ?        00:00:00 ./mgr PARAMFILE /data/ogg/ggs12/dirprm/mgr.prm REPORTFILE /data/ogg/ggs12/dirrpt/MGR.rpt PROCESSID MGRapp       97030  96606  0 23:35 pts/0    00:00:00 grep --color=auto mgr[app@OGG-CLIENT data]$ kill -9 96817[app@OGG-CLIENT data]$ cd ggs12/[app@OGG-CLIENT ggs12]$ ./ggsci 
    [app@OGG-CLIENT ogg]$ mv ggs12/ ./..
    ---再次报错

    [app@OGG-CLIENT ggs12]$ ./ggsci Oracle GoldenGate for Big DataVersion 12.3.1.1.1
    Oracle GoldenGate Command InterpreterVersion 12.3.0.1.0 OGGCORE_OGGADP.12.3.0.1.0GA_PLATFORMS_170828.1608Linux, x64, 64bit (optimized), Generic on Aug 28 2017 17:13:45Operating system character set identified as UTF-8.
    Copyright (C) 1995, 2017, Oracle and/or its affiliates. All rights reserved.


    Source Context :  SourceModule            : [ggparam.repo]  SourceID                : [/scratch/aime/adestore/views/aime_adc4150324/oggcore/OpenSys/src/gglib/ggparam/paramrepo.cpp]  SourceMethod            : [open_specfile]  SourceLine              : [1221]  ThreadBacktrace         : [15] elements                          : [/data/ggs12/libgglog.so(CMessageContext::AddThreadContext()+0x1e) [0x7fc673a2e54e]]                          : [/data/ggs12/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, ...)+0x6ac) [0x7fc673a1ed4c]]                          : [/data/ggs12/libgglog.so(_MSG_String_Int32_String(CSourceContext*, int, char const*, int, char const*, CMessageFactory::MessageDisposition)+0x4a) [0x7fc673a1226a]]                          : [/data/ggs12/libggparam.so(ggs::ggparam::repo::open_specfile(char const*)+0x2f0) [0x7fc671b833b0]]                          : [/data/ggs12/libggparam.so(ggs::ggparam::repo::open()+0x51) [0x7fc671b849e1]]                          : [/data/ggs12/libggparam.so(ggs::ggparam::dict::dict()+0x104) [0x7fc671b8ccf4]]                          : [/data/ggs12/libggparam.so(ggs::ggparam::dict::instance()+0x43) [0x7fc671b8cea3]]                          : [./ggsci(readGlobalConfigFile()+0x59) [0x54b929]]                          : [./ggsci() [0x62cecb]]                          : [./ggsci(ggs::gglib::MultiThreading::MainThread::ExecMain()+0x5e) [0x5550de]]                          : [./ggsci(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::ThreadArgs*)+0x173) [0x5594a3]]                          : [./ggsci(ggs::gglib::MultiThreading::MainThread::Run(int, char**)+0x140) [0x559d10]]                          : [./ggsci(main+0x3b) [0x64c1cb]]                          : [/lib64/libc.so.6(__libc_start_main+0xf5) [0x7fc66d119445]]                          : [./ggsci(__gxx_personality_v0+0x299) [0x4b6529]]
    2019-08-20 23:38:14  ERROR   OGG-10111  Error opening parameter definition file: /data/ogg/ggs12/ggparam.dat.errno: 2 - No such file or directory.
    2019-08-20 23:38:14  WARNING OGG-01525  Failed to open trace output file, '/data/ogg/ggs12/dirdmp/gglog-ggsci.dmp', error 2 (No such file or directory).
    2019-08-20 23:38:14  ERROR   OGG-01668  PROCESS ABENDING.[app@OGG-CLIENT ggs12]$ cd [app@OGG-CLIENT ~]$ vi .bash_profile [app@OGG-CLIENT ~]$ export OGG_HOME=[app@OGG-CLIENT ~]$ cd /data/ggs12/[app@OGG-CLIENT ggs12]$ ./ggsci Oracle GoldenGate for Big DataVersion 12.3.1.1.1
    Oracle GoldenGate Command InterpreterVersion 12.3.0.1.0 OGGCORE_OGGADP.12.3.0.1.0GA_PLATFORMS_170828.1608Linux, x64, 64bit (optimized), Generic on Aug 28 2017 17:13:45Operating system character set identified as UTF-8.
    Copyright (C) 1995, 2017, Oracle and/or its affiliates. All rights reserved.


    GGSCI (OGG-CLIENT) 1> info all
    Program     Status      Group       Lag at Chkpt  Time Since Chkpt
    MANAGER     STOPPED                                           REPLICAT    ABENDED     REP_K1    00:00:00      01:07:47    REPLICAT    ABENDED     REP_K2    00:00:00      01:07:47    REPLICAT    ABENDED     REP_K3    00:00:00      01:07:46    REPLICAT    ABENDED     REP_K4    00:00:00      01:07:45    REPLICAT    ABENDED     REP_K5    00:00:00      01:07:45    

    GGSCI (OGG-CLIENT) 2> start mgrManager started.

    GGSCI (OGG-CLIENT) 3> info mgr
    Manager is running (IP port OGG-CLIENT.8909, Process ID 97094).

    GGSCI (OGG-CLIENT) 4> info all
    Program     Status      Group       Lag at Chkpt  Time Since Chkpt
    MANAGER     RUNNING                                           REPLICAT    ABENDED     REP_K1    00:00:00      01:07:56    REPLICAT    ABENDED     REP_K2    00:00:00      01:07:56    REPLICAT    ABENDED     REP_K3    00:00:00      01:07:55    REPLICAT    ABENDED     REP_K4    00:00:00      01:07:54    REPLICAT    ABENDED     REP_K5    00:00:00      01:07:53    

    GGSCI (OGG-CLIENT) 5> start REP_K1
    Sending START request to MANAGER ...REPLICAT REP_K1 starting

    GGSCI (OGG-CLIENT) 6> info REP_K1
    REPLICAT   REP_K1  Last Started 2019-08-20 23:41   Status RUNNINGCheckpoint Lag       00:00:00 (updated 01:08:03 ago)Process ID           97103Log Read Checkpoint  File /data/ggs12/dirdat/t1002322                     First Record  RBA 49652169

    GGSCI (OGG-CLIENT) 7> !info REP_K1
    REPLICAT   REP_K1  Last Started 2019-08-20 23:41   Status RUNNINGCheckpoint Lag       01:11:06 (updated 00:00:00 ago)Process ID           97103Log Read Checkpoint  File /data/ggs12/dirdat/t1002324                     2019-08-20 22:30:41.200193  RBA 8347811
    [app@OGG-CLIENT ~]$ vi .bash_profile [app@OGG-CLIENT ~]$ cat .bash_profile # .bash_profile
    # Get the aliases and functionsif [ -f ~/.bashrc ]; then. ~/.bashrcfi
    # User specific environment and startup programs
    #export OGG_HOME=/data/ogg/ggs12export OGG_HOME=/data/ggs12JAVA_HOME="/home/app/jdk1.8.0_101"CLASSPATH="$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib"NODE_HOME="/home/app/node-v8.11.2-linux-x64"PATH=$PATH:$HOME/.local/bin:$HOME/bin:$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$NODE_HOME/binexport LD_LIBRARY_PATH=$JAVA_HOME/jre/lib/amd64:$JAVA_HOME/jre/lib/amd64/libjsig.so:$JAVA_HOME/jre/lib/amd64/server:$JAVA_HOME/jre/lib/amd64/server/libjvm.so:$LD_LIBRARY_PATHstty erase ^h
    export PATH
    [app@OGG-CLIENT ~]$ source .bash_profile[app@OGG-CLIENT ~]$ cd /data/ggs12/

    ogg for kafka 平滑过渡方案落地   注意:原目标端ogg目录是啥,到目标端 ogg目录还得一致。

  • 相关阅读:
    8051单片机指令和寻址方式
    C/C++的关系
    go JSON 读写到文件
    Oracle 对未提交事务的查询
    win8 iis 安装
    Silverlight 项目 对话框
    VisualSVN错误 Cannot query proxy blanket解决办法
    silverlight浏览器自适应问题
    windows server2003 多用户登陆问题解决办法
    silverlight 缺少对象错误
  • 原文地址:https://www.cnblogs.com/ss-33/p/11419557.html
Copyright © 2011-2022 走看看