========================================================== uDAPL and InfiniBand ========================================================== 1.uDAPL的全称 User-Level Direct Access Programming Library (uDAPL.) (user Direct Access Programming Language) used with InfiniBand to perform RDMA (Remote Direct Memory Access)
2.pureScale各个member通过IB channel上的uDAPL接口来和CF通信 All members communicate to both CFs using uDAPL over an InfiniBand channel -Members use the CF client API -CF Server (ca-server) communicates with CF client API (member, db2sysc) over InfiniBand 3. InfiniBand -Channel that communication goes over -Comparable to ethernet -Communication aside from uDAPL may also be done over IB rsh, ssh, etc
4. InfiniBand Supported Cards For AIX: Galaxy 2 cards, for Linux: Melanox 5. AIX操作系统 uDAPL/IB 信息收集 uDAPL/IB Info to Collect/View
Listed here are pieces of info that may be viewed on a live system (AIX) --5.1 errpt –a -Look for error messages from IB --5.2 ping <hostname> -From and to each host to see if hosts are still able to communicate over IB --5.3 lsdev –C -Check if the devices are still available:
coralpib07:/home/svtdbm6 >lsdev -C | grep -i infiniband ib0 Available IP over Infiniband Network Interface iba0 Available InfiniBand host channel adapter icm Available Infiniband Communication Manager
--5.4 ibstat -v -shows IB adapter information IB configuration --5.5 ifconfig -a -shows all adapters' information on the host --5.6 ifconfig <interface name> -Similar to ifconfig –a. In a few cases may provide added info --5.7 arp -t ib –a -shows who the current host last communicated with; other hosts in the cluster should be listed here --5.8 snap –Y (if not already collected) -Work going in to dump this automatically in FODC directories -**Most important if not already dumped --5.9 Many of these now integrated into snap –Y and db2support
6.Linux操作系统下 uDAPL/IB信息收集 uDAPL/IB Info to Collect/View
--6.1 /var/log/messages -Look for error messages from IB -additional logging into this log also possible --6.2 ping <hostname> -From and to each host to see if hosts are still able to communicate over IB --6.3 ibstat -shows IB adapter information IB configuration --6.4 ifconfig –a -shows all adapters' information on the host --6.5 ibswportwatch.pl -Gives hints to when there may be lost packets
7.uDAPL Terminology uDAPL – user Direct Access Programming Language RDMA – Remote Direct Memory Access IB – InfiniBand ICM – InfiniBand Communication Manager EP - Endpoint MRB - Message Response Block MCB - Message Command Block EVD - Event Dispatcher CQ - Completion Queue QP - Queue Pair ( SEND/RECIEVE) DAT - Direct Access Transport DTO - Data transfer Operation LID - Location Identifier HCA - Host Channel Adapter
添加新评论1 条评论
2013-01-25 11:04