Oracle Goldengate Windows平台Oracle-Oracle单向复制

实验目的

Goldengate最基本的从源端一对一的单向复制，注意其中Goldengate版本取决于Oracle的版本。单向复制一般适用于保持目标数据库的实时更新，且目标数据库用来检索，如报表或者分析使用。

Source DB

操作系统：Windows 10 64
Oracle版本:Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
GoldenGate版本：Version 11.2.1.0.1

Target DB

操作系统：Windows 7 64
Oracle版本：Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
GoldenGate：Version 11.2.1.0.1

配置GoldenGate软件

分两种，一种是免安装，一种是通过exe文件进行安装；这里我使用的是免安装，把压缩包解压到c:ggs目录即可，目标端和源端路径一致。

1.设置环境变量

我的电脑右键属性，选择高级系统设置，高级里面找到环境变量，添加系统变量

完成后，进入DOS命令窗口(win+r)输入：echo %ORACLE_HOME%，echo %ORACLE_SID%

Microsoft Windows [版本 10.0.16299.726]
(c) 2017 Microsoft Corporation。保留所有权利。

C:UsersAdministrator>echo %ORACLE_HOME%
D:appAdministratorproduct11.2.0dbhome_1

C:UsersAdministrator>echo %ORACLE_SID%
orcl

C:UsersAdministrator>

2.开始配置GoldenGate

将GoldenGate解压至c:ggs，进入ggs目录，运行ggsci，随后创建子目录

Microsoft Windows [版本 10.0.16299.726]
(c) 2017 Microsoft Corporation。保留所有权利。

C:UsersAdministrator>cd ggs

C:ggs>ggsci

Oracle GoldenGate Command Interpreter for Oracle
Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230
Windows x64 (optimized), Oracle 11g on Apr 23 2012 04:55:02

Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.



GGSCI (DESKTOP-8NP7VO0) 1> Create subdirs

Creating subdirectories under current directory C:ggs

Parameter files                C:ggsdirprm: already exists
Report files                   C:ggsdirrpt: created
Checkpoint files               C:ggsdirchk: created
Process status files           C:ggsdirpcs: created
SQL script files               C:ggsdirsql: created
Database definitions files     C:ggsdirdef: created
Extract data files             C:ggsdirdat: created
Temporary files                C:ggsdirtmp: created
Stdout files                   C:ggsdirout: created

主目录介绍

dirchk：存放检查点（Checkpoint）文件
dirdat：存放Trail与Extract文件，以后详述
dirdef：通过DEFGEN工具生成的源或目标的数据定义文件
dirpcs：存放进程状态文件
dirprm：存放参数文件
dirrpt：存放进程报告文件
dirsql：存放SQL脚本文件
dirtmp：当事务所需要的内存超过已分配内存时，缺省存储于此。

3.添加manager进程到Windows系统服务

edit params ./GLOBALS命令（注意./GLOBALS为大写），进入编辑文件，输入下面内容：

MGRSERVNAME GGMGR

保存退出后，用install addservice命令添加服务，如下所示

GGSCI (DESKTOP-8NP7VO0) 2> edit params ./GLOBALS


GGSCI (DESKTOP-8NP7VO0) 3> exit

C:ggs>install addservice

Service 'GGMGR' created.


Install program terminated normally.

4.命令解释

GGSCI (DESKTOP-8NP7VO0) 1> help


GGSCI Command Summary:

Object:          Command:
SUBDIRS          CREATE
ER               INFO, KILL, LAG, SEND, STATUS, START, STATS, STOP
EXTRACT          ADD, ALTER, CLEANUP, DELETE, INFO, KILL,
                 LAG, REGISTER, SEND, START, STATS, STATUS, STOP
                 UNREGISTER
EXTTRAIL         ADD, ALTER, DELETE, INFO
GGSEVT           VIEW
MANAGER          INFO, SEND, START, STOP, STATUS
MARKER           INFO
PARAMS           EDIT, VIEW
REPLICAT         ADD, ALTER, CLEANUP, DELETE, INFO, KILL, LAG, SEND,
                 START, STATS, STATUS, STOP
REPORT           VIEW
RMTTRAIL         ADD, ALTER, DELETE, INFO
TRACETABLE       ADD, DELETE, INFO
TRANDATA         ADD, DELETE, INFO
SCHEMATRANDATA   ADD, DELETE, INFO
CHECKPOINTTABLE  ADD, DELETE, CLEANUP, INFO

Commands without an object:
(Database)       DBLOGIN, LIST TABLES, ENCRYPT PASSWORD, FLUSH SEQUENCE
                 MININGDBLOGIN
(DDL)            DUMPDDL
(Miscellaneous)  FC, HELP, HISTORY, INFO ALL, OBEY, SET EDITOR, SHELL,
                 SHOW, VERSIONS, ! (note: you must type the word
                 COMMAND after the ! to display the ! help topic.)
                 i.e.: GGSCI (sys1)> help ! command



For help on a specific command, type HELP <command> <object>.

Example: HELP ADD REPLICAT

GGSCI (DESKTOP-8NP7VO0) 2>

配置Oracle数据库

1.进入数据库SYS用户创建GoldenGate管理用户，并授予相应的权限，测试环境直接给DBA即可，生产环境请严格控制

CREATE USER GGS IDENTIFIED BY "ggs" DEFAULT TABLESPACE USERS TEMPORARY TABLESPACE TEMP;
GRANT DBA TO GGS_SOURCE;

2.在源端打开归档模式，我这里已经配置好了，按照下面的命令执行即可

SQL>archive log list;
SQL>shutdown immediate;
SQL>startup mount;
SQL>alter database archivelog;
SQL>startup force;

3.查看是否打开数据库级别的补充日志,返回结果为Y即可

SELECT SUPPLEMENTAL_LOG_DATA_MIN FROM V$DATABASE;

如果查询结果不是Y，需要打开数据库级别的补充日志

ALTER DATABASE ADD SUPPLEMENTAL LOG DATA;

4.增加表级最小日志

AlTER TABLE BJXXJGXT.RYJBXXB ADD SUPPLEMENTAL LOG DATA (PRIMARY KEY) COLUMNS;
AlTER TABLE BJXXJGXT.KSSZPB ADD SUPPLEMENTAL LOG DATA (PRIMARY KEY) COLUMNS;

5.在源端库中关闭回收站，如果是oracle 10.1版本使用alter system set "_recyclebin=off"

SQL> show parameter recyclebin
 
NAME TYPE VALUE
------------- ----------- ------------------------------
recyclebin string on
 
SQL> alter system set recyclebin=off;
 
System altered.

6.在源端添加表级的Trandata，表名可以使用通配符，如add trandata bjxxjgxt.*

GGSCI (DESKTOP-8NP7VO0) 1> dblogin userid ggs_test,password 123456
Successfully logged into database.

GGSCI (DESKTOP-8NP7VO0) 2> add trandata bjxxjgxt.ryjbxxb

Logging of supplemental redo log data is already enabled for table BJXXJGXT.RYJBXXB.

配置goldengate进程组-目标端

在源端：mgr进程，extract（抽取）进程，pump进程

在目标端：mgr进程，replicat（复制）

1.配置源端mgr管理进程

GGSCI (DESKTOP-8NP7VO0) 3> edit params mgr


GGSCI (DESKTOP-8NP7VO0) 4> view params mgr
port 7500  #MGR进程通信端口
dynamicportlist 7501-7505 #Manager进程可以为源端和目标端的动态的指定端口
autorestart extract *,waitminutes 2,retries 5 #autorestart extract表示自动重启Extract进程组,每次尝试的时间间隔为2秒，最多尝试5次，如果没有成功则放弃

启动mgr

GGSCI (DESKTOP-8NP7VO0) 5> start mgr

Starting Manager as service ('GGMGR')...
Service started.


GGSCI (DESKTOP-8NP7VO0) 6> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING

2.配置源端Extract抽取进程组

编辑添加extract进程配置文件

GGSCI (DESKTOP-8NP7VO0) 7> edit params eora

添加如下内容

extract eora #表一个名为eora的extract进程
dynamicresolution #GoldenGatex动态解析源端表名
userid ggs_test,password 123456 #ogg专用用户密码
--setenv(ORACLE_SID=ORCL) #设置环境变量
exttrail c:ggsdirdatet #文件目录和标识（类似于et*这样文件)，命名只能是2个字符。
table bjxxjgxt.ryjbxxb; #同步那些表,表名可以用通配符*代替,*代表该用户下所有表

添加extract进程

GGSCI (DESKTOP-8NP7VO0) 8> add extract eora,tranlog,begin now
EXTRACT added.

创建本地trail文件，extract进程组负责写这部分文件，pump进程负责读取它

GGSCI (DESKTOP-8NP7VO0) 9> add exttrail c:ggsdirdatet,extract eora
EXTTRAIL added.

启动eora进程，使用start eora或start ext eora或start extract eora

GGSCI (DESKTOP-8NP7VO0) 10> start eora

Sending START request to MANAGER ('GGMGR') ...
EXTRACT EORA starting

GGSCI (DESKTOP-8NP7VO0) 11> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING
EXTRACT     RUNNING     EORA        00:00:25      00:00:01

3.配置源端pump进程组

编辑添加pump进程配置文件

GGSCI (DESKTOP-8NP7VO0) 12> edit params pump

添加如下内容

extract pump #一个名为pump的extract进程
Dynamicresolution #GoldenGatex动态解析源端表名
userid ggs_test,password 123456 #ogg用户和密码
rmthost 192.168.11.91, mgrport 7500 #指定目标端IP和mgr端口
--Setenv(ORACLE_SID=ORCL) #设置环境变量
rmttrail c:ggsdirdatet #
table bjxxjgxt.ryjbxxb;

添加pump进程

GGSCI (DESKTOP-8NP7VO0) 13> add extract pump,exttrailsource c:ggsdirdatet
EXTRACT added. 

添加该rmttrail

GGSCI (DESKTOP-8NP7VO0) 14> add rmttrail c:ggsdirdatet,extract pump
RMTTRAIL added.

启动pump进程，最终结果如下图所示，如有异常请查看进程组日志

GGSCI (DESKTOP-8NP7VO0) 15> start pump

Sending START request to MANAGER ('GGMGR') ...
EXTRACT PUMP starting

GGSCI (DESKTOP-8NP7VO0) 16> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING
EXTRACT     RUNNING     EORA        00:00:00      00:00:03
EXTRACT     RUNNING     PUMP        00:00:00      00:00:24

配置目标端MGR管理进程

1.依据源端的配置，配置目标端mgr进程；在目标机器上编辑GLOBALS文件，添加一行，checkpointtable ggs.checkpoint

Microsoft Windows [版本 6.1.7601]
版权所有 (c) 2009 Microsoft Corporation。保留所有权利。

C:UsersAdministrator>cd ggs

C:ggs>ggsci

Oracle GoldenGate Command Interpreter for Oracle
Version 11.2.1.0.1 OGGCORE_11.2.1.0.1_PLATFORMS_120423.0230
Windows x64 (optimized), Oracle 11g on Apr 23 2012 04:55:02

Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved.

GGSCI (Roobbin-PC) 1> create subdirs

Creating subdirectories under current directory C:ggs

Parameter files                C:ggsdirprm: already exists
Report files                   C:ggsdirrpt: created
Checkpoint files               C:ggsdirchk: created
Process status files           C:ggsdirpcs: created
SQL script files               C:ggsdirsql: created
Database definitions files     C:ggsdirdef: created
Extract data files             C:ggsdirdat: created
Temporary files                C:ggsdirtmp: created
Stdout files                   C:ggsdirout: created

GGSCI (Roobbin-PC) 2> edit params ./GLOBAL

添加如下内容

MGRSERVNAME GGMGR

checkpointtable ggs.checkpoint

添加系统服务

GGSCI (Roobbin-PC) 3> exit

C:ggs>install addservice

Service 'GGMGR' created.

Install program terminated normally.

增加检测机制

GGSCI (Roobbin-PC) 1> dblogin userid ggs_test,password 123456
Successfully logged into database.

GGSCI (Roobbin-PC) 2> add checkpointtable ggs_test.checkpoint

Successfully created checkpoint table ggs_test.checkpoint.

2.依据源端的配置，配置目标端mgr进程

GGSCI (Roobbin-PC) 3> edit params mgr

添加如下内容

port 7500
dynamicportlist 7501-7505
autostart er *
autorestart extract *,waitminutes 2,retries 5
lagreporthours 1
laginfominutes 3
lagcriticalminutes 5
purgeoldextracts c:ggdirdatet*,usecheckpoints,minkeepdays 3

3.配置目标端Replicat复制进程组

编辑添加Replicat进程配置文件

GGSCI (Roobbin-PC) 5> edit params repl

添加如下内容

replicat repl
userid ggs_test,password 123456
assumetargetdefs
reperror default,discard
discardfile ./dirrpt/repl.dsc,append,megabytes 50
dynamicresolution
MAP bjxxjgxt.ryjbxxb, target bjxxjgxt.ryjbxxb;

添加replicat进程

GGSCI (Roobbin-PC) 6> add replicat repl,exttrail c:ggsdirdatet,checkpointtable ggs_test.checkpoint
REPLICAT added.

启动mgr，repl

GGSCI (Roobbin-PC) 19> start mgr

Starting Manager as service ('GGMGR')...
Service started.

GGSCI (Roobbin-PC) 20> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING
REPLICAT    RUNNING     REPL        00:00:00      00:00:08

随后就是验证DDL操作结果。这个就自行去操作把，这里不多讲了，有问题就查日志