源端:mysql 8.0.12
目标端:oracle 12c
问题描叙:
运行稳定的源端抽取进程异常
GGSCI (DB-MYSQL-0-30) 45> info all
Program Status Group Lag at Chkpt Time Since Chkpt
MANAGER RUNNING
EXTRACT ABENDED EXTDW1 00:00:00 00:00:18
EXTRACT RUNNING PUSHDW1 00:00:00 00:00:02
查看日志:
2019-11-04T09:15:14.074+0800 INFO OGG-00975 Oracle GoldenGate Manager for MySQL, mgr.prm: EXTRACT EXTDW1 starting.
2019-11-04T09:15:14.074+0800 INFO OGG-00965 Oracle GoldenGate Manager for MySQL, mgr.prm: EXTRACT EXTDW1 restarted automatically.
2019-11-04T09:15:14.163+0800 INFO OGG-00992 Oracle GoldenGate Capture for MySQL, extdw1.prm: EXTRACT EXTDW1 starting.
2019-11-04T09:15:14.163+0800 INFO OGG-03059 Oracle GoldenGate Capture for MySQL, extdw1.prm: Operating system character set identified as UTF-8.
2019-11-04T09:15:14.163+0800 INFO OGG-02695 Oracle GoldenGate Capture for MySQL, extdw1.prm: ANSI SQL parameter syntax is used for parameter parsing.
2019-11-04T09:15:14.163+0800 INFO OGG-02095 Oracle GoldenGate Capture for MySQL, extdw1.prm: Successfully set environment variable MYSQL_HOME=/appl/mysql.
2019-11-04T09:15:14.163+0800 INFO OGG-02095 Oracle GoldenGate Capture for MySQL, extdw1.prm: Successfully set environment variable NLS_LANG=AMERICAN_AMERICA.AL32UTF8.
2019-11-04T09:15:14.180+0800 WARNING OGG-10173 Oracle GoldenGate Capture for MySQL, extdw1.prm: (extdw1.prm) line 7: Parsing error, [dynamicresolution] is deprecated.
2019-11-04T09:15:14.301+0800 INFO OGG-01851 Oracle GoldenGate Capture for MySQL, extdw1.prm: filecaching started: thread ID: 140627441383168.
2019-11-04T09:15:14.310+0800 INFO OGG-01815 Oracle GoldenGate Capture for MySQL, extdw1.prm: Virtual Memory Facilities for: COM
anon alloc: mmap(MAP_ANON) anon free: munmap
file alloc: mmap(MAP_SHARED) file free: munmap
target directories:
/appl/ggmysql/dirtmp.
2019-11-04T09:15:14.399+0800 INFO OGG-00993 Oracle GoldenGate Capture for MySQL, extdw1.prm: EXTRACT EXTDW1 started.
2019-11-04T09:15:14.400+0800 INFO OGG-01055 Oracle GoldenGate Capture for MySQL, extdw1.prm: Recovery initialization completed for target file /appl/ggmysql/dirdat/w1000001623, at RBA 1379.
2019-11-04T09:15:14.400+0800 INFO OGG-01478 Oracle GoldenGate Capture for MySQL, extdw1.prm: Output file /appl/ggmysql/dirdat/w1 is using format RELEASE 12.3.
2019-11-04T09:15:14.410+0800 INFO OGG-01026 Oracle GoldenGate Capture for MySQL, extdw1.prm: Rolling over remote file /appl/ggmysql/dirdat/w1000001623.
2019-11-04T09:15:14.444+0800 INFO OGG-01053 Oracle GoldenGate Capture for MySQL, extdw1.prm: Recovery completed for target file /appl/ggmysql/dirdat/w1000001624, at RBA 1379.
2019-11-04T09:15:14.444+0800 INFO OGG-01057 Oracle GoldenGate Capture for MySQL, extdw1.prm: Recovery completed for all targets.
2019-11-04T09:15:14.453+0800 INFO OGG-00182 Oracle GoldenGate Capture for MySQL, extdw1.prm: VAM API running in single-threaded mode.
2019-11-04T09:15:14.453+0800 INFO OGG-01513 Oracle GoldenGate Capture for MySQL, extdw1.prm: Positioning to Log Number: 38
Record Offset: 864941833.
2019-11-04T09:15:14.677+0800 INFO OGG-02232 Oracle GoldenGate Capture for MySQL, pushdw1.prm: Switching to next trail file /appl/ggmysql/dirdat/w1000001624 at 2019-11-04 09:15:14.677395 due to EOF. with current RBA 1,379.
2019-11-04T09:15:15.523+0800 INFO OGG-01516 Oracle GoldenGate Capture for MySQL, extdw1.prm: Positioned to LogNum - 38
Record Offset - 864941833, 2019 M11 3 00:43:33.
2019-11-04T09:15:15.548+0800 INFO OGG-01517 Oracle GoldenGate Capture for MySQL, extdw1.prm: Position of first record processed Log Number: 38
Record Offset: 864941994, 2019 M11 3 00:43:33.
view report extdw1查看进程报告(部分报告如下)
Operating System Version:
Linux
Version #1 SMP Thu Nov 8 23:39:32 UTC 2018, Release 3.10.0-957.el7.x86_64
Node: DB-MYSQL-0-30
Machine: x86_64
soft limit hard limit
Address Space Size : unlimited unlimited
Heap Size : unlimited unlimited
File Size : unlimited unlimited
CPU Time : unlimited unlimited
Process id: 19980
Description:
***********************************************************************
** Running with the following parameters **
***********************************************************************
2019-11-04 09:53:16 INFO OGG-03059 Operating system character set identified as UTF-8.
2019-11-04 09:53:16 INFO OGG-02695 ANSI SQL parameter syntax is used for parameter parsing.
2019-11-04 09:53:16 INFO OGG-02095 Successfully set environment variable MYSQL_HOME=/appl/mysql.
2019-11-04 09:53:16 INFO OGG-02095 Successfully set environment variable NLS_LANG=AMERICAN_AMERICA.AL32UTF8.
2019-11-04 09:53:16 WARNING OGG-10173 extdw1.prm: (extdw1.prm) line 7: Parsing error, [dynamicresolution] is deprecated.
extract extdw1
setenv (MYSQL_HOME="/appl/mysql")
setenv (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
tranlogoptions altlogdest /appl/mysql/data/mysql-bin-8201.index
sourcedb *****,userid root,password ***
exttrail /appl/ggmysql/dirdat/w1
gettruncates
第一次尝试:因为没有更为具体的error信息,根据日志和report内容
GGSCI (DB-MYSQL-0-30) 69> edit param extdw1
extract extdw1
setenv (MYSQL_HOME="/appl/mysql")
setenv (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
tranlogoptions altlogdest /appl/mysql/data/mysql-bin-8201.index
sourcedb traindb,userid root,password sm7#ktsc
exttrail /appl/ggmysql/dirdat/w1
--dynamicresolution
gettruncates
注释掉了第7行dynamicresolution参数,尝试重启抽取进程,并没有效果,问题照旧。
最后处理方式:
目标端复制进程,源端推送进程都停止。
然后
alter extract EXTDW1, tranlog, begin now
start EXTDW1
查看进程抽取进程状态一切正常,在启动推送进程和复制进程。
PS:问题的原因还是没有找到,只是讨巧直接从当前时间点开始拉取日志,恢复ogg功能,问题出现时间内的数据是不一致的,需要人工补齐,因此对数据变化量很大的ogg任务不太适用。另外异构ogg数据同步的稳定性个人感觉还是没有同构好。
版权声明:本文为博主原创文章,未经博主允许不得转载。
ogg
- 上一篇:redis 安装和报错解决
- 下一篇:msql 8.0.12 主从搭建






