參考：
https://blog.csdn.net/asdfaa/article/details/137884414
檢查系統是否支持 IPv6,查看被禁用了
在啓用 IPv6 之前，首先要確保您的系統支持 IPv6。要檢查內核是否啓用了 IPv6，可以運行以下命令：
cat /proc/sys/net/ipv6/conf/all/disable_ipv6
如果返回的結果爲 0，則說明您的系統支持 IPv6。如果結果爲 1，您需要啓用 IPv6，然後重新檢查。
檢查下面兩個服務。opensmd 沒有啓動，直接啓動，然後用ibstat命令
systemctl status opensmd
systemctl status openibd
ibstat
cat /proc/sys/net/ipv6/conf/all/disable_ipv6
echo 1 >/proc/sys/net/ipv6/conf/all/disable_ipv6
一開始端口是down， 現在是active，然後就可以用了
root@gpumcw2:/home/mcw# ibstat CA 'mlx5_0' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae03009cc36c System image GUID: 0x946dae03009cc36c Port 1: State: Initializing Physical state: LinkUp Rate: 200 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0xa651e848 Port GUID: 0x946dae03009cc36c Link layer: InfiniBand CA 'mlx5_1' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae03009cc364 System image GUID: 0x946dae03009cc364 Port 1: State: Initializing Physical state: LinkUp Rate: 200 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0xa651e848 Port GUID: 0x946dae03009cc364 Link layer: InfiniBand CA 'mlx5_2' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae0300b00278 System image GUID: 0x946dae0300b00278 Port 1: State: Down Physical state: Polling Rate: 10 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0xa651e848 Port GUID: 0x946dae0300b00278 Link layer: InfiniBand CA 'mlx5_3' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae0300b00279 System image GUID: 0x946dae0300b00278 Port 1: State: Down Physical state: Polling Rate: 10 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0xa651e848 Port GUID: 0x946dae0300b00279 Link layer: InfiniBand CA 'mlx5_4' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae03009cc374 System image GUID: 0x946dae03009cc374 Port 1: State: Initializing Physical state: LinkUp Rate: 200 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0xa651e848 Port GUID: 0x946dae03009cc374 Link layer: InfiniBand CA 'mlx5_5' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae03009cef04 System image GUID: 0x946dae03009cef04 Port 1: State: Initializing Physical state: LinkUp Rate: 200 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0xa651e848 Port GUID: 0x946dae03009cef04 Link layer: InfiniBand root@gpumcw2:/home/mcw#
root@gpumcw2:/home/mcw# ibstat CA 'mlx5_0' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae03009cc36c System image GUID: 0x946dae03009cc36c Port 1: State: Active Physical state: LinkUp Rate: 200 Base lid: 2 LMC: 0 SM lid: 2 Capability mask: 0xa651e84a Port GUID: 0x946dae03009cc36c Link layer: InfiniBand CA 'mlx5_1' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae03009cc364 System image GUID: 0x946dae03009cc364 Port 1: State: Active Physical state: LinkUp Rate: 200 Base lid: 16 LMC: 0 SM lid: 2 Capability mask: 0xa651e848 Port GUID: 0x946dae03009cc364 Link layer: InfiniBand CA 'mlx5_2' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae0300b00278 System image GUID: 0x946dae0300b00278 Port 1: State: Down Physical state: Polling Rate: 10 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0xa651e848 Port GUID: 0x946dae0300b00278 Link layer: InfiniBand CA 'mlx5_3' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae0300b00279 System image GUID: 0x946dae0300b00278 Port 1: State: Down Physical state: Polling Rate: 10 Base lid: 65535 LMC: 0 SM lid: 0 Capability mask: 0xa651e848 Port GUID: 0x946dae0300b00279 Link layer: InfiniBand CA 'mlx5_4' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae03009cc374 System image GUID: 0x946dae03009cc374 Port 1: State: Active Physical state: LinkUp Rate: 200 Base lid: 20 LMC: 0 SM lid: 2 Capability mask: 0xa651e848 Port GUID: 0x946dae03009cc374 Link layer: InfiniBand CA 'mlx5_5' CA type: MT4123 Number of ports: 1 Firmware version: 20.38.1002 Hardware version: 0 Node GUID: 0x946dae03009cef04 System image GUID: 0x946dae03009cef04 Port 1: State: Active Physical state: LinkUp Rate: 200 Base lid: 5 LMC: 0 SM lid: 2 Capability mask: 0xa651e848 Port GUID: 0x946dae03009cef04 Link layer: InfiniBand root@gpumcw2:/home/mcw#
另外一個機器上指定接口去ping沒有用ipv6的這個接口的IP
root@gpumcw2:/home/mcw# ifconfig ibs13 ibs13: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 2044 inet 10.xx.xx.8 netmask 255.255.255.0 broadcast 10.110.10.255 inet6 fe80::966d:ae03:9c:c36c prefixlen 64 scopeid 0x20<link> unspec 00-00-08-0D-FE-80-00-00-00-00-00-00-00-00-00-00 txqueuelen 256 (UNSPEC) RX packets 2146 bytes 379613 (379.6 KB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 2151 bytes 278364 (278.3 KB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 root@gpumcw2:/home/mcw# root@gpumcw2:/home/mcw# ping -I ibs13 10.xx.xx.8 PING 10.xx.xx.8 (10.xx.xx.8) from 10.110.10.1 ibs13: 56(84) bytes of data. 64 bytes from 10.xx.xx.8: icmp_seq=1 ttl=64 time=0.324 ms 64 bytes from 10.xx.xx.8: icmp_seq=2 ttl=64 time=0.103 ms ^C --- 10.xx.xx.8 ping statistics --- 2 packets transmitted, 2 received, 0% packet loss, time 1032ms rtt min/avg/max/mdev = 0.103/0.213/0.324/0.110 ms root@gpumcw2:/home/mcw#
沒好之前lo狀態
好了之後狀態
