签到成功

知道了

CNDBA社区CNDBA社区

ORACLE 11G R2 RAC添加节点时候的报错

2020-02-28 11:06 2482 1 Oracle

环境:
当前RAC里有2个节点erpdb61、erpdb62,准备添加第三个节点erpdb67,三个节点已经配置完ssh互信、hosts等其他系统参数
第一次在第一个节点进行clufy预检查的时候发现节点3的2个网卡名称跟其他2个节点不一样,然后修改节点3的网卡、重启系统后网卡名称已经与其他2个节点一致
以下是3个节点的hosts文件

#public ip
192.168.2.61   erpdb61
192.168.2.62   erpdb62
192.168.2.67   erpdb67


#private ip
10.10.20.61 erpdb61priv
10.10.20.62 erpdb62priv
10.10.20.67 erpdb67priv

#vip
192.168.2.63  erpdb61vip
192.168.2.64  erpdb62vip
192.168.2.68  erpdb67vip

#scan ip
192.168.2.65  erpdbscan

以下是节点1的网卡ip信息:

[root@erpdb61 ~]# ip a

    1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
        link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
        inet 127.0.0.1/8 scope host lo
           valid_lft forever preferred_lft forever
        inet6 ::1/128 scope host 
           valid_lft forever preferred_lft forever
    2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 00:0c:29:a9:c6:ee brd ff:ff:ff:ff:ff:ff
        inet 192.168.2.61/24 brd 192.168.2.255 scope global noprefixroute ens33
           valid_lft forever preferred_lft forever
        inet 192.168.2.65/24 brd 192.168.2.255 scope global secondary ens33:1
           valid_lft forever preferred_lft forever
        inet 192.168.2.63/24 brd 192.168.2.255 scope global secondary ens33:3
           valid_lft forever preferred_lft forever
        inet6 fe80::e9d6:dbf7:6ed8:39ad/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    3: ens34: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
        link/ether 00:0c:29:a9:c6:f8 brd ff:ff:ff:ff:ff:ff
        inet 10.10.20.61/24 brd 10.10.20.255 scope global noprefixroute ens34
           valid_lft forever preferred_lft forever
        inet 169.254.162.237/16 brd 169.254.255.255 scope global ens34:1
           valid_lft forever preferred_lft forever
        inet6 fe80::5a4c:53e:5ee:6c37/64 scope link noprefixroute 
           valid_lft forever preferred_lft forever
    4: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
        link/ether 52:54:00:6f:b8:54 brd ff:ff:ff:ff:ff:ff
        inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
           valid_lft forever preferred_lft forever
    5: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000
        link/ether 52:54:00:6f:b8:54 brd ff:ff:ff:ff:ff:ff

以下是节点2的网卡ip信息:

[root@erpdb62 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether 00:0c:29:4f:23:8e brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.62/24 brd 192.168.2.255 scope global noprefixroute ens33
       valid_lft forever preferred_lft forever
    inet 192.168.2.64/24 brd 192.168.2.255 scope global secondary ens33:1
       valid_lft forever preferred_lft forever
    inet6 fe80::eb56:893e:3ba7:2285/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever
3: ens34: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether 00:0c:29:4f:23:98 brd ff:ff:ff:ff:ff:ff
    inet 10.10.20.62/24 brd 10.10.20.255 scope global noprefixroute ens34
       valid_lft forever preferred_lft forever
    inet 169.254.68.255/16 brd 169.254.255.255 scope global ens34:1
       valid_lft forever preferred_lft forever
    inet6 fe80::daa9:74b4:7bbd:461f/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever
4: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
    link/ether 52:54:00:1b:57:dd brd ff:ff:ff:ff:ff:ff
    inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
       valid_lft forever preferred_lft forever
5: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000
    link/ether 52:54:00:1b:57:dd brd ff:ff:ff:ff:ff:ff

以下是节点3的网卡ip信息:

[root@erpdb67 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether 00:0c:29:df:61:42 brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.67/24 brd 192.168.2.255 scope global ens33
       valid_lft forever preferred_lft forever
    inet6 fe80::20c:29ff:fedf:6142/64 scope link 
       valid_lft forever preferred_lft forever
3: ens34: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
    link/ether 00:0c:29:df:61:4c brd ff:ff:ff:ff:ff:ff
    inet 10.10.20.67/24 brd 10.10.20.255 scope global ens34
       valid_lft forever preferred_lft forever
    inet6 fe80::20c:29ff:fedf:614c/64 scope link 
       valid_lft forever preferred_lft forever
4: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
    link/ether 52:54:00:96:c8:6d brd ff:ff:ff:ff:ff:ff
    inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
       valid_lft forever preferred_lft forever
5: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000
    link/ether 52:54:00:96:c8:6d brd ff:ff:ff:ff:ff:ff

再次进行检查的时候,结果如下:

[grid@erpdb61:/home/grid]$cluvfy stage -post hwos -n erpdb67 -verbose

Performing post-checks for hardware and operating system setup 

Checking node reachability...

Check: Node reachability from node "erpdb61"
  Destination Node                      Reachable?              
  ------------------------------------  ------------------------
  erpdb67                               yes                     
Result: Node reachability check passed from node "erpdb61"


Checking user equivalence...

Check: User equivalence for user "grid"
  Node Name                             Status                  
  ------------------------------------  ------------------------
  erpdb67                               passed                  
Result: User equivalence check passed for user "grid"

Checking node connectivity...

Checking hosts config file...
  Node Name                             Status                  
  ------------------------------------  ------------------------
  erpdb67                               passed                  

Verification of the hosts config file successful


Interface information for node "erpdb67"
 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU   
 ------ --------------- --------------- --------------- --------------- ----------------- ------
 ens33  192.168.2.67    192.168.2.0     0.0.0.0         UNKNOWN         00:0C:29:DF:61:42 1500  
 ens34  10.10.20.67     10.10.20.0      0.0.0.0         UNKNOWN         00:0C:29:DF:61:4C 1500  
 virbr0 192.168.122.1   192.168.122.0   0.0.0.0         UNKNOWN         52:54:00:96:C8:6D 1500  
 Check: Node connectivity for interface "ens33"
Result: Node connectivity passed for interface "ens33"


Check: TCP connectivity of subnet "192.168.2.0"
  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
  erpdb61:192.168.2.61            erpdb67:192.168.2.67            passed          
Result: TCP connectivity check passed for subnet "192.168.2.0"


Check: Node connectivity for interface "ens34"
Result: Node connectivity passed for interface "ens34"


Check: TCP connectivity of subnet "10.10.20.0"
  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
  erpdb61:192.168.2.61            erpdb67:10.10.20.67             failed          

ERROR: 
PRVF-7617 : Node connectivity between "erpdb61 : 192.168.2.61" and "erpdb67 : 10.10.20.67" failed
Result: TCP connectivity check failed for subnet "10.10.20.0"


Result: Node connectivity check failed

Checking multicast communication...

Checking subnet "192.168.2.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "192.168.2.0" for multicast communication with multicast group "230.0.1.0" passed.

Checking subnet "10.10.20.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "10.10.20.0" for multicast communication with multicast group "230.0.1.0" passed.

Check of multicast communication passed.

Checking for multiple users with UID value 0
Result: Check for multiple users with UID value 0 passed 
Check: Time zone consistency 
Result: Time zone consistency check passed

Checking shared storage accessibility...

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sda                              erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdb                              erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdc                              erpdb67                 
  /dev/sde                              erpdb67                 
  /dev/sdh                              erpdb67                 
  /dev/sdl                              erpdb67                 
  /dev/mapper/fs-backup01               erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdd                              erpdb67                 
  /dev/sdg                              erpdb67                 
  /dev/sdj                              erpdb67                 
  /dev/sdm                              erpdb67                 
  /dev/mapper/fs-backup02               erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdf                              erpdb67                 
  /dev/sdi                              erpdb67                 
  /dev/sdk                              erpdb67                 
  /dev/sdo                              erpdb67                 
  /dev/mapper/fs-backup03               erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdn                              erpdb67                 
  /dev/sdq                              erpdb67                 
  /dev/sdw                              erpdb67                 
  /dev/sdab                             erpdb67                 
  /dev/mapper/asm-dggrid1               erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdp                              erpdb67                 
  /dev/sds                              erpdb67                 
  /dev/sdz                              erpdb67                 
  /dev/sdaf                             erpdb67                 
  /dev/mapper/asm-dggrid2               erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdr                              erpdb67                 
  /dev/sdu                              erpdb67                 
  /dev/sdac                             erpdb67                 
  /dev/sdai                             erpdb67                 
  /dev/mapper/asm-dggrid3               erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdt                              erpdb67                 
  /dev/sdx                              erpdb67                 
  /dev/sdag                             erpdb67                 
  /dev/sdan                             erpdb67                 
  /dev/mapper/asm-dggrid4               erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdv                              erpdb67                 
  /dev/sdaa                             erpdb67                 
  /dev/sdak                             erpdb67                 
  /dev/sdar                             erpdb67                 
  /dev/mapper/asm-dggrid5               erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdy                              erpdb67                 
  /dev/sdae                             erpdb67                 
  /dev/sdao                             erpdb67                 
  /dev/sdav                             erpdb67                 
  /dev/mapper/asm-dggrid6               erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdad                             erpdb67                 
  /dev/sdaj                             erpdb67                 
  /dev/sdau                             erpdb67                 
  /dev/sdaz                             erpdb67                 
  /dev/mapper/asm-dgsystem01            erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdah                             erpdb67                 
  /dev/sdal                             erpdb67                 
  /dev/sdaw                             erpdb67                 
  /dev/sdbd                             erpdb67                 
  /dev/mapper/asm-dgrecovery01          erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdam                             erpdb67                 
  /dev/sdaq                             erpdb67                 
  /dev/sdbc                             erpdb67                 
  /dev/sdbe                             erpdb67                 
  /dev/mapper/asm-data01                erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdap                             erpdb67                 
  /dev/sdat                             erpdb67                 
  /dev/sdbg                             erpdb67                 
  /dev/sdbi                             erpdb67                 
  /dev/mapper/asm-data02                erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdas                             erpdb67                 
  /dev/sday                             erpdb67                 
  /dev/sdbh                             erpdb67                 
  /dev/sdbj                             erpdb67                 
  /dev/mapper/asm-data03                erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdax                             erpdb67                 
  /dev/sdba                             erpdb67                 
  /dev/sdbk                             erpdb67                 
  /dev/sdbl                             erpdb67                 
  /dev/mapper/asm-dgsystem02            erpdb67                 

  Disk                                  Sharing Nodes (1 in count)
  ------------------------------------  ------------------------
  /dev/sdbb                             erpdb67                 
  /dev/sdbf                             erpdb67                 
  /dev/sdbm                             erpdb67                 
  /dev/sdbn                             erpdb67                 
  /dev/mapper/asm-dgrecovery02          erpdb67                 


Shared storage check was successful on nodes "erpdb67"

Checking integrity of name service switch configuration file "/etc/nsswitch.conf" ...
Checking if "hosts" entry in file "/etc/nsswitch.conf" is consistent across nodes...
Checking file "/etc/nsswitch.conf" to make sure that only one "hosts" entry is defined
More than one "hosts" entry does not exist in any "/etc/nsswitch.conf" file
Check for integrity of name service switch configuration file "/etc/nsswitch.conf" passed


Post-check for hardware and operating system setup was unsuccessful on all the nodes. 


检查失败:Check: TCP connectivity of subnet "10.10.20.0"
  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
  erpdb61:192.168.2.61            erpdb67:10.10.20.67             failed          

ERROR: 
PRVF-7617 : Node connectivity between "erpdb61 : 192.168.2.61" and "erpdb67 : 10.10.20.67" failed
Result: TCP connectivity check failed for subnet "10.10.20.0"

这个问题我有点搞不懂了,为什么erpdb61用public ip去跟erpdb67的private ip进行测试呢?
这2个IP不在同一个网段啊

用户回答
* 以下用户言论只代表其个人观点,不代表CNDBA社区的观点或立场
ME_infinite

ME_infinite

关注
  • 0
    原创
  • 0
    翻译
  • 0
    转载
  • 0
    评论
  • 访问:2483次
  • 积分:2
  • 等级:注册会员
  • 排名:第639名
精华文章
    最新问题
    查看更多+
    热门文章
      热门用户
      推荐用户
        Copyright © 2016 All Rights Reserved. Powered by ZhiXinTech · 皖ICP备19020168号·

        QQ交流群