CNDBA社区
环境：
当前RAC里有2个节点erpdb61、erpdb62，准备添加第三个节点erpdb67，三个节点已经配置完ssh互信、hosts等其他系统参数
第一次在第一个节点进行clufy预检查的时候发现节点3的2个网卡名称跟其他2个节点不一样，然后修改节点3的网卡、重启系统后网卡名称已经与其他2个节点一致
以下是3个节点的hosts文件
#public ip
192.168.2.61 erpdb61
192.168.2.62 erpdb62
192.168.2.67 erpdb67
#private ip
10.10.20.61 erpdb61priv
10.10.20.62 erpdb62priv
10.10.20.67 erpdb67priv
#vip
192.168.2.63 erpdb61vip
192.168.2.64 erpdb62vip
192.168.2.68 erpdb67vip
#scan ip
192.168.2.65 erpdbscan
以下是节点1的网卡ip信息：
[root@erpdb61 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
link/ether 00:0c:29:a9:c6:ee brd ff:ff:ff:ff:ff:ff
inet 192.168.2.61/24 brd 192.168.2.255 scope global noprefixroute ens33
valid_lft forever preferred_lft forever
inet 192.168.2.65/24 brd 192.168.2.255 scope global secondary ens33:1
valid_lft forever preferred_lft forever
inet 192.168.2.63/24 brd 192.168.2.255 scope global secondary ens33:3
valid_lft forever preferred_lft forever
inet6 fe80::e9d6:dbf7:6ed8:39ad/64 scope link noprefixroute
valid_lft forever preferred_lft forever
3: ens34: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
link/ether 00:0c:29:a9:c6:f8 brd ff:ff:ff:ff:ff:ff
inet 10.10.20.61/24 brd 10.10.20.255 scope global noprefixroute ens34
valid_lft forever preferred_lft forever
inet 169.254.162.237/16 brd 169.254.255.255 scope global ens34:1
valid_lft forever preferred_lft forever
inet6 fe80::5a4c:53e:5ee:6c37/64 scope link noprefixroute
valid_lft forever preferred_lft forever
4: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
link/ether 52:54:00:6f:b8:54 brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
valid_lft forever preferred_lft forever
5: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:6f:b8:54 brd ff:ff:ff:ff:ff:ff
以下是节点2的网卡ip信息：
[root@erpdb62 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
link/ether 00:0c:29:4f:23:8e brd ff:ff:ff:ff:ff:ff
inet 192.168.2.62/24 brd 192.168.2.255 scope global noprefixroute ens33
valid_lft forever preferred_lft forever
inet 192.168.2.64/24 brd 192.168.2.255 scope global secondary ens33:1
valid_lft forever preferred_lft forever
inet6 fe80::eb56:893e:3ba7:2285/64 scope link noprefixroute
valid_lft forever preferred_lft forever
3: ens34: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
link/ether 00:0c:29:4f:23:98 brd ff:ff:ff:ff:ff:ff
inet 10.10.20.62/24 brd 10.10.20.255 scope global noprefixroute ens34
valid_lft forever preferred_lft forever
inet 169.254.68.255/16 brd 169.254.255.255 scope global ens34:1
valid_lft forever preferred_lft forever
inet6 fe80::daa9:74b4:7bbd:461f/64 scope link noprefixroute
valid_lft forever preferred_lft forever
4: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
link/ether 52:54:00:1b:57:dd brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
valid_lft forever preferred_lft forever
5: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:1b:57:dd brd ff:ff:ff:ff:ff:ff
以下是节点3的网卡ip信息：
[root@erpdb67 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ens33: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
link/ether 00:0c:29:df:61:42 brd ff:ff:ff:ff:ff:ff
inet 192.168.2.67/24 brd 192.168.2.255 scope global ens33
valid_lft forever preferred_lft forever
inet6 fe80::20c:29ff:fedf:6142/64 scope link
valid_lft forever preferred_lft forever
3: ens34: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
link/ether 00:0c:29:df:61:4c brd ff:ff:ff:ff:ff:ff
inet 10.10.20.67/24 brd 10.10.20.255 scope global ens34
valid_lft forever preferred_lft forever
inet6 fe80::20c:29ff:fedf:614c/64 scope link
valid_lft forever preferred_lft forever
4: virbr0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
link/ether 52:54:00:96:c8:6d brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
valid_lft forever preferred_lft forever
5: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:96:c8:6d brd ff:ff:ff:ff:ff:ff
再次进行检查的时候，结果如下：
[grid@erpdb61:/home/grid]$cluvfy stage -post hwos -n erpdb67 -verbose
Performing post-checks for hardware and operating system setup
Checking node reachability...
Check: Node reachability from node "erpdb61"
Destination Node Reachable?
------------------------------------ ------------------------
erpdb67 yes
Result: Node reachability check passed from node "erpdb61"
Checking user equivalence...
Check: User equivalence for user "grid"
Node Name Status
------------------------------------ ------------------------
erpdb67 passed
Result: User equivalence check passed for user "grid"
Checking node connectivity...
Checking hosts config file...
Node Name Status
------------------------------------ ------------------------
erpdb67 passed
Verification of the hosts config file successful
Interface information for node "erpdb67"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
ens33 192.168.2.67 192.168.2.0 0.0.0.0 UNKNOWN 00:0C:29:DF:61:42 1500
ens34 10.10.20.67 10.10.20.0 0.0.0.0 UNKNOWN 00:0C:29:DF:61:4C 1500
virbr0 192.168.122.1 192.168.122.0 0.0.0.0 UNKNOWN 52:54:00:96:C8:6D 1500
Check: Node connectivity for interface "ens33"
Result: Node connectivity passed for interface "ens33"
Check: TCP connectivity of subnet "192.168.2.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
erpdb61:192.168.2.61 erpdb67:192.168.2.67 passed
Result: TCP connectivity check passed for subnet "192.168.2.0"
Check: Node connectivity for interface "ens34"
Result: Node connectivity passed for interface "ens34"
Check: TCP connectivity of subnet "10.10.20.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
erpdb61:192.168.2.61 erpdb67:10.10.20.67 failed
ERROR:
PRVF-7617 : Node connectivity between "erpdb61 : 192.168.2.61" and "erpdb67 : 10.10.20.67" failed
Result: TCP connectivity check failed for subnet "10.10.20.0"
Result: Node connectivity check failed
Checking multicast communication...
Checking subnet "192.168.2.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "192.168.2.0" for multicast communication with multicast group "230.0.1.0" passed.
Checking subnet "10.10.20.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "10.10.20.0" for multicast communication with multicast group "230.0.1.0" passed.
Check of multicast communication passed.
Checking for multiple users with UID value 0
Result: Check for multiple users with UID value 0 passed
Check: Time zone consistency
Result: Time zone consistency check passed
Checking shared storage accessibility...
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sda erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdb erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdc erpdb67
/dev/sde erpdb67
/dev/sdh erpdb67
/dev/sdl erpdb67
/dev/mapper/fs-backup01 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdd erpdb67
/dev/sdg erpdb67
/dev/sdj erpdb67
/dev/sdm erpdb67
/dev/mapper/fs-backup02 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdf erpdb67
/dev/sdi erpdb67
/dev/sdk erpdb67
/dev/sdo erpdb67
/dev/mapper/fs-backup03 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdn erpdb67
/dev/sdq erpdb67
/dev/sdw erpdb67
/dev/sdab erpdb67
/dev/mapper/asm-dggrid1 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdp erpdb67
/dev/sds erpdb67
/dev/sdz erpdb67
/dev/sdaf erpdb67
/dev/mapper/asm-dggrid2 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdr erpdb67
/dev/sdu erpdb67
/dev/sdac erpdb67
/dev/sdai erpdb67
/dev/mapper/asm-dggrid3 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdt erpdb67
/dev/sdx erpdb67
/dev/sdag erpdb67
/dev/sdan erpdb67
/dev/mapper/asm-dggrid4 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdv erpdb67
/dev/sdaa erpdb67
/dev/sdak erpdb67
/dev/sdar erpdb67
/dev/mapper/asm-dggrid5 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdy erpdb67
/dev/sdae erpdb67
/dev/sdao erpdb67
/dev/sdav erpdb67
/dev/mapper/asm-dggrid6 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdad erpdb67
/dev/sdaj erpdb67
/dev/sdau erpdb67
/dev/sdaz erpdb67
/dev/mapper/asm-dgsystem01 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdah erpdb67
/dev/sdal erpdb67
/dev/sdaw erpdb67
/dev/sdbd erpdb67
/dev/mapper/asm-dgrecovery01 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdam erpdb67
/dev/sdaq erpdb67
/dev/sdbc erpdb67
/dev/sdbe erpdb67
/dev/mapper/asm-data01 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdap erpdb67
/dev/sdat erpdb67
/dev/sdbg erpdb67
/dev/sdbi erpdb67
/dev/mapper/asm-data02 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdas erpdb67
/dev/sday erpdb67
/dev/sdbh erpdb67
/dev/sdbj erpdb67
/dev/mapper/asm-data03 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdax erpdb67
/dev/sdba erpdb67
/dev/sdbk erpdb67
/dev/sdbl erpdb67
/dev/mapper/asm-dgsystem02 erpdb67
Disk Sharing Nodes (1 in count)
------------------------------------ ------------------------
/dev/sdbb erpdb67
/dev/sdbf erpdb67
/dev/sdbm erpdb67
/dev/sdbn erpdb67
/dev/mapper/asm-dgrecovery02 erpdb67
Shared storage check was successful on nodes "erpdb67"
Checking integrity of name service switch configuration file "/etc/nsswitch.conf" ...
Checking if "hosts" entry in file "/etc/nsswitch.conf" is consistent across nodes...
Checking file "/etc/nsswitch.conf" to make sure that only one "hosts" entry is defined
More than one "hosts" entry does not exist in any "/etc/nsswitch.conf" file
Check for integrity of name service switch configuration file "/etc/nsswitch.conf" passed
Post-check for hardware and operating system setup was unsuccessful on all the nodes.
检查失败：Check: TCP connectivity of subnet "10.10.20.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
erpdb61:192.168.2.61 erpdb67:10.10.20.67 failed
ERROR:
PRVF-7617 : Node connectivity between "erpdb61 : 192.168.2.61" and "erpdb67 : 10.10.20.67" failed
Result: TCP connectivity check failed for subnet "10.10.20.0"
这个问题我有点搞不懂了，为什么erpdb61用public ip去跟erpdb67的private ip进行测试呢？
这2个IP不在同一个网段啊
