签到成功

知道了

CNDBA社区CNDBA社区

记一次ogg源端抽取进程异常问题

2019-11-04 13:05 9905 0 原创 OGG
作者: shmily

源端:mysql 8.0.12
目标端:oracle 12c

问题描叙:
运行稳定的源端抽取进程异常

http://www.cndba.cn/asker/article/3780
http://www.cndba.cn/asker/article/3780
http://www.cndba.cn/asker/article/3780
http://www.cndba.cn/asker/article/3780

GGSCI (DB-MYSQL-0-30) 45> info all
Program     Status      Group       Lag at Chkpt  Time Since Chkpt
MANAGER     RUNNING                                           
EXTRACT     ABENDED     EXTDW1      00:00:00      00:00:18    
EXTRACT     RUNNING     PUSHDW1     00:00:00      00:00:02

查看日志:

http://www.cndba.cn/asker/article/3780

2019-11-04T09:15:14.074+0800  INFO    OGG-00975  Oracle GoldenGate Manager for MySQL, mgr.prm:  EXTRACT EXTDW1 starting.
2019-11-04T09:15:14.074+0800  INFO    OGG-00965  Oracle GoldenGate Manager for MySQL, mgr.prm:  EXTRACT EXTDW1 restarted automatically.
2019-11-04T09:15:14.163+0800  INFO    OGG-00992  Oracle GoldenGate Capture for MySQL, extdw1.prm:  EXTRACT EXTDW1 starting.
2019-11-04T09:15:14.163+0800  INFO    OGG-03059  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Operating system character set identified as UTF-8.
2019-11-04T09:15:14.163+0800  INFO    OGG-02695  Oracle GoldenGate Capture for MySQL, extdw1.prm:  ANSI SQL parameter syntax is used for parameter parsing.
2019-11-04T09:15:14.163+0800  INFO    OGG-02095  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Successfully set environment variable MYSQL_HOME=/appl/mysql.
2019-11-04T09:15:14.163+0800  INFO    OGG-02095  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Successfully set environment variable NLS_LANG=AMERICAN_AMERICA.AL32UTF8.
2019-11-04T09:15:14.180+0800  WARNING OGG-10173  Oracle GoldenGate Capture for MySQL, extdw1.prm:  (extdw1.prm) line 7: Parsing error, [dynamicresolution] is deprecated.
2019-11-04T09:15:14.301+0800  INFO    OGG-01851  Oracle GoldenGate Capture for MySQL, extdw1.prm:  filecaching started: thread ID: 140627441383168.
2019-11-04T09:15:14.310+0800  INFO    OGG-01815  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Virtual Memory Facilities for: COM
                                  anon alloc: mmap(MAP_ANON)  anon free: munmap
                                  file alloc: mmap(MAP_SHARED)  file free: munmap
                                  target directories:
                                  /appl/ggmysql/dirtmp.
2019-11-04T09:15:14.399+0800  INFO    OGG-00993  Oracle GoldenGate Capture for MySQL, extdw1.prm:  EXTRACT EXTDW1 started.
2019-11-04T09:15:14.400+0800  INFO    OGG-01055  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Recovery initialization completed for target file /appl/ggmysql/dirdat/w1000001623, at RBA 1379.
2019-11-04T09:15:14.400+0800  INFO    OGG-01478  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Output file /appl/ggmysql/dirdat/w1 is using format RELEASE 12.3.
2019-11-04T09:15:14.410+0800  INFO    OGG-01026  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Rolling over remote file /appl/ggmysql/dirdat/w1000001623.
2019-11-04T09:15:14.444+0800  INFO    OGG-01053  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Recovery completed for target file /appl/ggmysql/dirdat/w1000001624, at RBA 1379.
2019-11-04T09:15:14.444+0800  INFO    OGG-01057  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Recovery completed for all targets.
2019-11-04T09:15:14.453+0800  INFO    OGG-00182  Oracle GoldenGate Capture for MySQL, extdw1.prm:  VAM API running in single-threaded mode.
2019-11-04T09:15:14.453+0800  INFO    OGG-01513  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Positioning to Log Number: 38
                                  Record Offset: 864941833.
2019-11-04T09:15:14.677+0800  INFO    OGG-02232  Oracle GoldenGate Capture for MySQL, pushdw1.prm:  Switching to next trail file /appl/ggmysql/dirdat/w1000001624 at 2019-11-04 09:15:14.677395 due to EOF. with current RBA 1,379.
2019-11-04T09:15:15.523+0800  INFO    OGG-01516  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Positioned to LogNum - 38
                                Record Offset - 864941833, 2019 M11 3 00:43:33.
2019-11-04T09:15:15.548+0800  INFO    OGG-01517  Oracle GoldenGate Capture for MySQL, extdw1.prm:  Position of first record processed Log Number: 38
                                  Record Offset: 864941994, 2019 M11 3 00:43:33.

view report extdw1查看进程报告(部分报告如下)

Operating System Version:
Linux
Version #1 SMP Thu Nov 8 23:39:32 UTC 2018, Release 3.10.0-957.el7.x86_64
Node: DB-MYSQL-0-30
Machine: x86_64
                         soft limit   hard limit
Address Space Size   :    unlimited    unlimited
Heap Size            :    unlimited    unlimited
File Size            :    unlimited    unlimited
CPU Time             :    unlimited    unlimited
Process id: 19980
Description:
***********************************************************************
**            Running with the following parameters                  **
***********************************************************************
2019-11-04 09:53:16  INFO    OGG-03059  Operating system character set identified as UTF-8.
2019-11-04 09:53:16  INFO    OGG-02695  ANSI SQL parameter syntax is used for parameter parsing.
2019-11-04 09:53:16  INFO    OGG-02095  Successfully set environment variable MYSQL_HOME=/appl/mysql.
2019-11-04 09:53:16  INFO    OGG-02095  Successfully set environment variable NLS_LANG=AMERICAN_AMERICA.AL32UTF8.
2019-11-04 09:53:16  WARNING OGG-10173  extdw1.prm:  (extdw1.prm) line 7: Parsing error, [dynamicresolution] is deprecated.
extract extdw1
setenv (MYSQL_HOME="/appl/mysql")
setenv (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
tranlogoptions altlogdest /appl/mysql/data/mysql-bin-8201.index
sourcedb *****,userid root,password ***
exttrail /appl/ggmysql/dirdat/w1
gettruncates

第一次尝试:因为没有更为具体的error信息,根据日志和report内容

http://www.cndba.cn/asker/article/3780

GGSCI (DB-MYSQL-0-30) 69> edit param extdw1
extract extdw1
setenv (MYSQL_HOME="/appl/mysql")
setenv (NLS_LANG=AMERICAN_AMERICA.AL32UTF8)
tranlogoptions altlogdest /appl/mysql/data/mysql-bin-8201.index
sourcedb traindb,userid root,password sm7#ktsc
exttrail /appl/ggmysql/dirdat/w1
--dynamicresolution
gettruncates

注释掉了第7行dynamicresolution参数,尝试重启抽取进程,并没有效果,问题照旧。

http://www.cndba.cn/asker/article/3780
http://www.cndba.cn/asker/article/3780

最后处理方式:
目标端复制进程,源端推送进程都停止。
然后

http://www.cndba.cn/asker/article/3780

alter extract EXTDW1, tranlog, begin now
start EXTDW1

查看进程抽取进程状态一切正常,在启动推送进程和复制进程。

PS:问题的原因还是没有找到,只是讨巧直接从当前时间点开始拉取日志,恢复ogg功能,问题出现时间内的数据是不一致的,需要人工补齐,因此对数据变化量很大的ogg任务不太适用。另外异构ogg数据同步的稳定性个人感觉还是没有同构好。http://www.cndba.cn/asker/article/3780

版权声明:本文为博主原创文章,未经博主允许不得转载。

ogg

用户评论
* 以下用户言论只代表其个人观点,不代表CNDBA社区的观点或立场
shmily

shmily

关注
  • 22
    原创
  • 0
    翻译
  • 2
    转载
  • 11
    评论
  • 访问:142148次
  • 积分:141
  • 等级:初级会员
  • 排名:第23名
精华文章
    热门文章
      Copyright © 2016 All Rights Reserved. Powered by CNDBA · 皖ICP备2022006297号-1·

      AI QQ群