zoukankan      html  css  js  c++  java
  • OGG_GoldenGate日常监控(案例)

    2014-03-11 Created By BaoXinjian

     一、摘要


    对GoldenGate实例进行监控,可以公国简单高效的方式GGSCI命令进行监控,并查看返回的信息,判断GoldenGate运行情况是否正常

    1. 使用GGSCI命令监控

    2. 通过ggserr.log日志监控

    3. 通过进入report目录文件监控

    4. 日常运维监控自动化脚本

     

     二、使用GGSCI命令监控


    1. info all

    (1). 作用:查看整体的运行情况

    (2). 示例

    GGSCI (gavinprod.com) 5> info all
    Program     Status      Group       Lag at Chkpt  Time Since Chkpt
    MANAGER     RUNNING                                           
    EXTRACT     RUNNING     DMP2        842:45:01     00:00:09    
    EXTRACT     RUNNING     EXT1        841:19:24     00:00:04    
    EXTRACT     RUNNING     EXT2        529:12:40     00:00:00 

    2. view params process

    (1). 作用:查看进程的参数设置

    (2). 示例

    GGSCI (gavinprod.com) 6> view params EXT1
    extract ext1
    userid ggate@gavinprod, password oracle
    rmthost odellprod.com, mgrport 7809
    rmttrail /opt/oracle/ggate/dirdat/lt
    ddl include mapped objname sender.*;
    table sender.*;

    3. info process

    (1). 作用:查看进程的信息性,包括进程的状态、Checkpoint信息、延时等

    (2). 示例

    GGSCI (gavinprod.com) 7> info EXT1
    EXTRACT    EXT1      Last Started 2015-01-28 05:31   Status RUNNING
    Checkpoint Lag       529:05:45 (updated 00:00:02 ago)
    Log Read Checkpoint  Oracle Redo Logs
                         2015-01-06 04:27:03  Seqno 24, RBA 18464196
                         SCN 0.1440415 (1440415)

    4. info process detail

    (1). 作用:查看更加详细的信息,包括所使用的trail文件、参数文件、报告文件、警告文件的位置

    (2). 示例

    GGSCI (gavinprod.com) 8> info EXT1 detail
    EXTRACT    EXT1      Last Started 2015-01-28 05:31   Status RUNNING
    Checkpoint Lag       431:32:57 (updated 00:00:04 ago)
    Log Read Checkpoint  Oracle Redo Logs
                         2015-01-10 06:00:18  Seqno 31, RBA 40079092
                         SCN 0.1553661 (1553661)
      Target Extract Trails:
      Remote Trail Name                                Seqno        RBA     Max MB
      /opt/oracle/ggate/dirdat/lt                          1       1105        100
      Extract Source                          Begin             End             
      /opt/oracle/flash_recovery_area/GAVINPROD/archivelog/2015_01_10/o1_mf_1_31_bc2d3p27_.arc  2014-12-24 04:12  2015-01-10 06:00
      /opt/oracle/oradata/gavinprod/redo01.log  2014-12-24 00:23  2014-12-24 04:12
      Not Available                           * Initialized *   2014-12-24 00:23
    Current directory    /opt/oracle/ggate
    Report file          /opt/oracle/ggate/dirrpt/EXT1.rpt
    Parameter file       /opt/oracle/ggate/dirprm/ext1.prm
    Checkpoint file      /opt/oracle/ggate/dirchk/EXT1.cpe
    Process file         /opt/oracle/ggate/dirpcs/EXT1.pce
    Stdout file          /opt/oracle/ggate/dirout/EXT1.out
    Error log            /opt/oracle/ggate/ggserr.log

    5. info process showch

    (1). 作用:查看详细的关于checkpoint的细心你想,用于查询GoldenGate进行处理过的事物记录

    Extract进程的Recovery checkpoing,他标识源数据最早的未被处理事物,可以查到该事物的redo log位于哪个日志文件以及该日志文件的序列号,所有序列号比它大得日志文件都需保留

    (2). 示例

    GGSCI (gavinprod.com) 9> info EXT1 showch
    EXTRACT    EXT1      Last Started 2015-01-28 05:31   Status RUNNING
    Checkpoint Lag       00:00:00 (updated 00:00:06 ago)
    Log Read Checkpoint  Oracle Redo Logs
                         2015-01-28 05:33:32  Seqno 42, RBA 2548736
                         SCN 0.1750257 (1750257)
    Current Checkpoint Detail:
    Read Checkpoint #1
      Oracle Redo Log
      Startup Checkpoint (starting position in the data source):
        Thread #: 1
        Sequence #: 19
        RBA: 37158416
        Timestamp: 2014-12-24 04:12:21.000000
        SCN: 0.1341390 (1341390)
        Redo File: /opt/oracle/oradata/gavinprod/redo01.log
      Recovery Checkpoint (position of oldest unprocessed transaction in the data source):
        Thread #: 1
        Sequence #: 42
        RBA: 2504208
        Timestamp: 2015-01-28 05:33:32.000000
        SCN: 0.1750256 (1750256)
        Redo File: /opt/oracle/oradata/gavinprod/redo03.log
      Current Checkpoint (position of last record read in the data source):
        Thread #: 1
        Sequence #: 42
        RBA: 2548736
        Timestamp: 2015-01-28 05:33:32.000000
        SCN: 0.1750257 (1750257)
        Redo File: /opt/oracle/oradata/gavinprod/redo03.log
    Write Checkpoint #1
      GGS Log Trail
      Current Checkpoint (current write position):
        Sequence #: 1
        RBA: 1105
        Timestamp: 2015-01-28 05:33:46.462178
        Extract Trail: /opt/oracle/ggate/dirdat/lt
    CSN state information:
      CRC: A4-7E-18-EE
      Latest CSN: 1749736
      Latest TXN: 7.29.894
      Latest CSN of finished TXNs: 1749736
      Completed TXNs: 7.29.894
    Header:
      Version = 2
      Record Source = A
      Type = 10
      # Input Checkpoints = 1
      # Output Checkpoints = 1
    File Information:
      Block Size = 2048
      Max Blocks = 100
      Record Length = 2048
      Current Offset = 0
    Configuration:
      Data Source = 3
      Transaction Integrity = 1
      Task Type = 0
    Status:
      Start Time = 2015-01-28 05:31:39
      Last Update Time = 2015-01-28 05:33:46
      Stop Status = A
      Last Result = 400

    6. lag process

    (1). 作用:查看详细的延时信息

    (2). 示例

    GGSCI (gavinprod.com) 10> lag EXT1
    Sending GETLAG request to EXTRACT EXT1 ...
    Last record lag: 23 seconds.
    At EOF, no more records to process.

    7. stats

    (1). 作用:查看进程处理的记录数

    (2). 示例

    GGSCI (gavinprod.com) 13> stats EXT1, total
    Sending STATS request to EXTRACT EXT1 ...
    Start of Statistics at 2015-01-28 05:37:59.
    DDL replication statistics (for all trails):
    *** Total statistics since extract started     ***
            Operations                                      2899.00
            Mapped operations                                  0.00
            Unmapped operations                             2809.00
            Other operations                                  90.00
            Excluded operations                             2899.00
    Output to /opt/oracle/ggate/dirdat/lt:
    Extracting from GGATE.GGS_MARKER to GGATE.GGS_MARKER:
    *** Total statistics since 2015-01-28 05:31:45 ***
            No database operations have been performed.
    End of Statistics.

    8. view report process

    (1). 作用:查看对应的报告文件

    (2). 示例

    GGSCI (gavinprod.com) 11> view report EXT1 
    ***********************************************************************
                     Oracle GoldenGate Capture for Oracle
        Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230_FBO
       Linux, x64, 64bit (optimized), Oracle 11g on Apr 23 2012 08:42:16
    Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.
                        Starting at 2015-01-28 05:31:33
    ***********************************************************************
    Operating System Version:
    Linux
    Version #1 SMP Mon Nov 12 02:14:55 EST 2007, Release 2.6.18-53.el5
    Node: gavinprod.com
    Machine: x86_64
                             soft limit   hard limit
    Address Space Size   :    unlimited    unlimited
    Heap Size            :    unlimited    unlimited
    File Size            :    unlimited    unlimited
    CPU Time             :    unlimited    unlimited
    Process id: 5097
    Description: 
    ***********************************************************************
    **            Running with the following parameters                  **
    ***********************************************************************
    2015-01-28 05:31:33  INFO    OGG-03035  Operating system character set identified as UTF-8. Locale: en_US, LC_ALL:.
    extract ext1
    userid ggate@gavinprod, password ******
    2015-01-28 05:31:35  INFO    OGG-03500  WARNING: NLS_LANG environment variable does not match database character set, or not set. 
    Using database character set value of AL32UTF8. rmthost odellprod.com, mgrport 7809 rmttrail /opt/oracle/ggate/dirdat/lt

     三、通过ggserr.log日志监控


    1. ggserr.log可以查看到的内容

    (1). GGSCI命令的历史记录

    (2). GoldenGate进程的启动和停止

    (3). 已执行的处理

    (4). 发生的错误

    (5). 信息和警告消息

    2. 如何查看 - 通过ggsevt命令

    GGSCI (gavinprod.com) 14> view ggsevt
    2014-09-10 01:26:35  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): edit params mgr.
    2014-09-10 01:27:16  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): edit params mgr.
    2014-09-10 01:27:27  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): start manager.
    2014-09-10 01:27:28  INFO    OGG-00983  Oracle GoldenGate Manager for Oracle, mgr.prm:  Manager started (port 7809).
    2014-09-10 01:27:40  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): add extract ext1  tranlog, begin now.
    2014-09-10 01:29:24  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): add exttrail2014-09-10 02:24:03
    2014-09-10 02:24:03  INFO    OGG-00983  Oracle GoldenGate Manager for Oracle, mgr.prm:  Manager started (port 7809).
    2014-09-10 02:24:07  INFO    OGG-00987  Oracle GoldenGate Command Interpreter for Oracle:  GGSCI command (ggate): start EXT1.
    2014-09-10 02:24:07  INFO    OGG-00963  Oracle GoldenGate Manager for Oracle, mgr.prm:  Command received from GGSCI on host gavinprod.com 
    2014-09-10 02:24:07  INFO    OGG-00975  Oracle GoldenGate Manager for Oracle, mgr.prm:  EXTRACT EXT1 starting.
    2014-09-10 02:24:08  INFO    OGG-00992  Oracle GoldenGate Capture for Oracle, ext1.prm:  EXTRACT EXT1 starting.
    2014-09-10 02:24:08  INFO    OGG-03035  Oracle GoldenGate Capture for Oracle, ext1.prm:  Operating system character set identified as UTF-8. 
    2014-09-10 02:24:19  INFO    OGG-01635  Oracle GoldenGate Capture for Oracle, ext1.prm:  BOUNDED RECOVERY: reset to initial or altered checkpoint.
    2014-09-10 02:24:19  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, ext1.prm:  Virtual Memory Facilities for: BR
        anon alloc: mmap(MAP_ANON)  anon free: munmap
        file alloc: mmap(MAP_SHARED)  file free: munmap
        target directories:
        /opt/oracle/ggate/BR/EXT1.
    2014-09-10 02:24:19  INFO    OGG-01815  Oracle GoldenGate Capture for Oracle, ext1.prm:  Virtual Memory Facilities for: COM
        anon alloc: mmap(MAP_ANON)  anon free: munmap
        file alloc: mmap(MAP_SHARED)  file free: munmap
        target directories:
        /opt/oracle/ggate/dirtmp.
    2014-09-10 02:24:20  WARNING OGG-01423  Oracle GoldenGate Capture for Oracle, ext1.prm:  No valid default archive log destination directory found

    3. 如可查看 - 通过gserr.log文件

    [ggate@gavinprod ggate]$ pwd
    /opt/oracle/ggate
    [ggate@gavinprod ggate]$ ls ggserr.log
    ggserr.log

     四、通过进入report目录文件监控


    1. 通过report文件

    [ggate@gavinprod dirrpt]$ pwd
    /opt/oracle/ggate/dirrpt
    [ggate@gavinprod dirrpt]$ ls -ltr
    total 260
    -rw-rw-rw- 1 ggate  oinstall  1182 Sep 10 01:27 MGR3.rpt
    -rw-rw-rw- 1 ggate  oinstall  1721 Sep 10 02:24 MGR2.rpt
    -rw-rw-rw- 1 ggate  oinstall  1721 Sep 16 19:06 MGR1.rpt
    -rw-rw-rw- 1 ggate  oinstall  4242 Sep 16 19:06 EXT19.rpt
    -rw-rw-rw- 1 oracle oinstall 21926 Dec 23 23:52 EXT18.rpt
    -rw-rw-rw- 1 oracle oinstall 20432 Dec 23 23:56 EXT17.rpt

    2. 通过discard文件

    [ggate@gavinprod dirrpt] $ pwd
    /opt/oracle/ggate/dirrpt
    [ggate@gavinprod dirrpt] $ ls *dsc
    REP1.dsc
    [ggate@gavinprod dirrpt] $ cat REP1.dsc
    OCI Error ORA-00001: unique constraint (RECEIVER.GAVIN_TEST) violated (status = 1), 
    SQL <INSERT INTO "RECEIVER"."GAVIN_TEST" ("ID","TEST_DATE","TEST_DESCRIPTION") VALUES (:a0,:a1,:a2)> Operation failed at seqno 388 rba 41327974 Discarding record on action DISCARD on error 1 Problem replicating SENDER.GAVIN_TEST to RECEIVER.GAVIN_TEST Mapping problem with insert record (target format)... * ID = 1 TEST_DATE = 2015-01-24 20:29:12 TEST_DESCRIPTION = GAVIN TEST OGG DISCARD *

     五、日常运维监控自动化脚本


     GoldenGate可运行监控脚本,用以监控OGG日常状态,和当前以及需要的归档号码

     

    Thanks and Regards

  • 相关阅读:
    写一个列表生成式,产生一个公差为11的等差数列
    如果对方网站反爬取,封IP了怎么办?
    为什么会选择redis数据库?
    你是否了解谷歌的无头浏览器?
    遇到的反爬虫策略以及解决方法?
    常见的HTTP方法有哪些?
    遇到反爬机制怎么处理?
    列举网络爬虫所用到的网络数据包,解析包?
    python中的关键字yield有什么作用?
    如下代码输出的是什么?
  • 原文地址:https://www.cnblogs.com/eastsea/p/4232314.html
Copyright © 2011-2022 走看看