注册登录
提 问
English中文版
风影子
作者风影子·2012-09-21 09:41
数据库管理员·深圳
关注22

【转】 SSH无密码登录-多节点自动化部署SHELL篇

字数 26631阅读 8815评论 0赞 1
来源：http://f.dataguru.cn/thread-19920-1-1.html
      
      在多个节点上手动配置SSH无密码登陆是个很闹心，又容易出错的事儿。如果有毅力的话，一台一台的配置，肯定是可以的，而且
可以提高打字的速度。但是如果在成千上万台集群节点上这么干的话，估计得把人给累死啦 

      所以这种吃力不讨好的活儿硬逼着同学们赶紧想办法让机器帮着我们干点活儿。

      终于经过长时间的失败，再失败，嘿嘿，现在大家看到的应该是可行的方案啦。
      希望可以节省大家的体力，当然也算抛砖引玉，希望大家可以有集思广益，搞出更多更好的方案，耶 ~

本解决方法主要包括两个脚本： sshpass.sh和ssh4slaves。
OS: CentOS 6.3 64 bit
大家需要在每个节点上提前装好"expect"工具，我们主要靠这个兄弟干活儿......, 具体脚本里面有说明

1. sshpass.sh
  1. #!/bin/bash
  2. # Name     : sshpass.sh
  3. # Time     : 17/09/2012
  4. # Author   : simplestone@dbinterest.com
  5. # Purpose  : For fast and easy setup of the SSH Passwordless access among all the nodes
  6. #            in a cluster. 
  7. # User     : Any user you are performing the test! Better to settup a separate user from your
  8. #            working env to avoid troubles!!! "root" is used in this example, and you can change it
  9. #            via the export virable "USER=root"
  10. # Attention: The test env is assuming that each $USER on each $HOST is usring the same password!
  11. #            And this likely makes sense as no body want to put more trouble on this.
  12. # Usage    : 1st, make sure the script has the execute permisison "chmod +x ssh_pass.sh"
  13. #            ./ssh_pass.sh password
  14. #          : 2nd, ensure the "ssh4slaves.sh" script is with ssh_pass.sh for all nodes setup!!!
  15. #          : 3rd, "expect" has to be installed on all the nodes for the SSH config

  17. export FILELOC="/root"
  18. export SLAVESFILE="$FILELOC/sshslaves"
  19. export HOSTS=`cat $FILELOC/sshhosts`
  20. export SLAVES=`cat $FILELOC/sshslaves`
  21. export SSH4SLAVESCRIPT="$FILELOC/ssh4slaves.sh"
  22. export MASTER=hdp01
  23. export USER=root
  24. export PASSWD=$1
  25. export SSHLOC="$FILELOC/.ssh/"
  26. export RSAFILE="$FILELOC/.ssh/id_rsa"
  27. export RSAPUBFILE="$FILELOC/.ssh/id_rsa.pub"
  28. export AUTHFILE="$FILELOC/.ssh/authorized_keys"
  29. export EXPECTCHK=`rpm -qa expect | wc -l`

  31. #
  32. if [ $EXPECTCHK != 1 ]
  33.   then
  34.   echo ''
  35.   echo "########################################################################################"
  36.   echo "Please install the "expect" package first on all nodes to allow the script to run!!!"
  37.   echo "yum -y install expect"
  38.   echo "########################################################################################"
  39. else
  40.   if [ -e $RSAFILE ]
  41.     then
  42.     echo "########################################################################################"
  43.     echo "Attention: This is for TEST ONLY, please fully test it before applying it to PROD"
  44.     echo "environment!!! OR you might get in trouble!!!"
  45.     echo ''
  46.     echo "BETTER TO HAVE A NEW USER FOR THE TEST TO AVOID DESTROYING YOUR ENVIRONMENT!"
  47.     echo ''
  48.     echo "Please manually delete the ssh related file on each host before executing the script!!!"
  49.     echo ''
  50.     for host in $HOSTS
  51.     do 
  52.     echo "Please run command on $host: rm -rf $SSHLOC"
  53.     done
  54.     echo "########################################################################################"
  55.   else
  56.   # Just generate 
  57.     for host in $HOSTS
  58.     do
  59.       if [ $host = "$MASTER" ]
  60.         then 
  61.         echo ''
  62.         echo "###########################################################"
  63.         echo "Generating RSA keys for MASTER host $MASTER"
  64.         echo "###########################################################"
  65.         echo ''
  66.         expect -c "
  67.             set timeout 1
  68.             spawn ssh $USER@$host
  69.             expect "yes/no"
  70.             send -- "yesr"
  71.             expect "password:"
  72.             send -- "$PASSWDr"
  73.             expect "#"
  74.             send "ssh-keygen -t rsa -P '' -f $RSAFILEr"
  75.             expect "#"
  76.             send "ssh-copy-id -i $RSAPUBFILE $MASTERr"
  77.             expect "password:"
  78.             send -- "$PASSWDr"
  79.             expect eof
  80.          "
  81.         else
  82.          echo ''
  83.          echo "###########################################################"
  84.          echo "Generating RSA keys for all OTHER hosts..."
  85.          echo "hostname is $host"
  86.          echo "###########################################################"
  87.          echo ''
  88.          expect -c "
  89.            set timeout 1
  90.            spawn ssh $USER@$host
  91.            expect "yes/no"
  92.            send -- "yesr"
  93.            expect "password:"
  94.            send -- "$PASSWDr"
  95.            expect "#"
  96.            send "ssh-keygen -t rsa -P '' -f $RSAFILEr"
  97.            expect "#"
  98.            send "ssh-copy-id -i $RSAPUBFILE $MASTERr"
  99.            expect "yes/no"
  100.            send -- "yesr"
  101.            expect "password:"
  102.            send -- "$PASSWDr"
  103.            expect eof
  104.            "
  105.          fi
  106.     done            
  107.           
  108.     ### 
  109.     for host in $SLAVES 
  110.     do
  111.         echo ''
  112.         echo "############################################################################"
  113.         echo "Copying authorized_keys to host $host from the MASTER host $MASTER..."
  114.         echo "############################################################################"
  115.         echo ''
  116.         expect -c "
  117.         set timeout 1
  118.         spawn scp $AUTHFILE "$USER@$host:$SSHLOC"
  119.         expect "password:"
  120.         send -- $PASSWDr
  121.         expect eof
  122.         "
  123.     done
  124.   
  125.   #
  126.     for host in $SLAVES
  127.     do
  128.       echo ''
  129.       echo "############################################################################"
  130.       echo "Distributing the $SLAVESFILE file to slave host $host..."
  131.       echo "############################################################################"
  132.       echo ''
  133.       scp $SLAVESFILE "$host:$FILELOC"
  134.       echo ''
  135.       echo "############################################################################"
  136.       echo "Distributing the $SSH4SLAVESCRIPT script to slave host $host..."
  137.       echo "############################################################################"
  138.       echo ''
  139.       scp $SSH4SLAVESCRIPT "$host:$FILELOC"
  140.     done
  141.   
  142.   
  143.     for host in $SLAVES
  144.     do
  145.       echo ''
  146.       echo "############################################################################"
  147.       echo "Working on the slaves node $host to ensure no prompt for the "yes/no" question..."
  148.       echo "############################################################################"
  149.       echo ''
  150.       ssh -q $USER@$host $SSH4SLAVESCRIPT
  151.     done
  152.     
  153.     ### Check whether the Passwordless ssh works ###
  154.     for host in $HOSTS
  155.     do
  156.       echo ''
  157.       echo "############################################################################"
  158.       echo "Check whether the Passwordless SSH works for $host..."
  159.       echo "############################################################################"
  160.       echo ''
  161.       ssh $host uname -a && date
  162.     done
  163.   fi
  164. fi
复制代码


2.ssh4slaves
  1. #!/bin/bash
  2. # Name     : ssh4slaves.sh
  3. # Time     : 17/09/2012
  4. # Author   : simplestone@dbinterest.com
  5. # Purpose  : For fast and easy setup of the SSH Passwordless access among all the slave nodes
  6. #            in a cluster. Mainly to ensure no prompt for "yes/no" again!!!
  7. # User     : Any user you are performing the test! Better to settup a separate user from your
  8. #            working env to avoid troubles!!! "root" is used in this example, and you can change it
  9. #            via the export virable "USER=root"
  10. # Attention: The test env is assuming that each $USER on each $HOST is usring the same password!
  11. #            And this likely makes sense as no body want to put more trouble on this.
  12. # Usage    : This script is called by the main script "ssh_pass.sh"
  13. #            1st, make sure the script has the execute permisison "chmod +x ssh4slaves.sh" before
  14. #            distributing it to other slaves node.
  15. #            2nd, Remember to change variable "PASSWORD" before start the main script "sshpass.sh" 

  17. export FILELOC="/root"
  18. export SLAVES=`cat $FILELOC/sshslaves`
  19. export USER=root
  20. export PASSWD=stonetest

  22. for host in $SLAVES
  23. do
  24.     echo ''
  25.     echo "Ensure ssh passwordless works among all slave nodes..."
  26.     echo ''
  27.     expect -c "
  28.         set timeout 1
  29.         spawn ssh $USER@$host
  30.         expect "yes/no"
  31.         send -- "yesr"
  32.         expect eof
  33.      "
  34. done
复制代码
3. 其他配置
  1. [root@hdp01 ~]# pwd
  2. /root
  3. [root@hdp01 ~]# cat sshhosts
  4. hdp01
  5. hdp02
  6. hdp03
  7. [root@hdp01 ~]# cat sshslaves
  8. hdp02
  9. hdp03
  10. [root@hdp01 ~]# ls -lrth | tail -2
  11. -rwxr-xr-x  1 root root 1.3K Sep 18 02:08 ssh4slaves.sh
  12. -rwxr-xr-x  1 root root 6.5K Sep 18 02:11 ssh_pass.sh
复制代码


4. 测试输出
  1. [root@hdp01 ~]# ./ssh_pass.sh stonetest

  3. ###########################################################
  4. Generating RSA keys for MASTER host hdp01
  5. ###########################################################

  7. spawn ssh root@hdp01
  8. The authenticity of host 'hdp01 (192.168.1.121)' can't be established.
  9. RSA key fingerprint is 23:fa:69:0b:a5:b0:c2:80:13:13:ba:2b:7d:b1:5b:ff.
  10. Are you sure you want to continue connecting (yes/no)? yes
  11. Warning: Permanently added 'hdp01,192.168.1.121' (RSA) to the list of known hosts.
  12. root@hdp01's password: 
  13. Last login: Tue Sep 18 02:09:29 2012 from hdp02.dbinterest.local
  14. [root@hdp01 ~]# ssh-keygen -t rsa -P '' -f /root/.ssh/id_rsa
  15. Generating public/private rsa key pair.
  16. Your identification has been saved in /root/.ssh/id_rsa.
  17. Your public key has been saved in /root/.ssh/id_rsa.pub.
  18. The key fingerprint is:
  19. 3a:c3:98:b3:e4:39:fa:fe:87:c6:22:90:16:57:4e:47 root@hdp01.dbinterest.local
  20. The key's randomart image is:
  21. +--[ RSA 2048]----+
  22. |      .E         |
  23. |     o .         |
  24. |    + .          |
  25. | . . .           |
  26. | .o     S        |
  27. |o.   + .         |
  28. |..  =.=.         |
  29. |  .oo++o.        |
  30. |  .=*=..         |
  31. +-----------------+
  32. [root@hdp01 ~]# ssh-copy-id -i /root/.ssh/id_rsa.pub hdp01
  33. root@hdp01's password: 
  34. Now try logging into the machine, with "ssh 'hdp01'", and check in:

  36.   .ssh/authorized_keys

  38. to make sure we haven't added extra keys that you weren't expecting.

  40. [root@hdp01 ~]# 
  41. ###########################################################
  42. Generating RSA keys for all OTHER hosts...
  43. hostname is hdp02
  44. ###########################################################

  46. spawn ssh root@hdp02
  47. The authenticity of host 'hdp02 (192.168.1.122)' can't be established.
  48. RSA key fingerprint is 23:fa:69:0b:a5:b0:c2:80:13:13:ba:2b:7d:b1:5b:ff.
  49. Are you sure you want to continue connecting (yes/no)? yes
  50. Warning: Permanently added 'hdp02,192.168.1.122' (RSA) to the list of known hosts.
  51. root@hdp02's password: 
  52. Last login: Tue Sep 18 02:09:23 2012 from hdp02.dbinterest.local
  53. [root@hdp02 ~]# ssh-keygen -t rsa -P '' -f /root/.ssh/id_rsa
  54. Generating public/private rsa key pair.
  55. Created directory '/root/.ssh'.
  56. Your identification has been saved in /root/.ssh/id_rsa.
  57. Your public key has been saved in /root/.ssh/id_rsa.pub.
  58. The key fingerprint is:
  59. a9:89:fe:40:8a:8e:21:55:da:3b:6b:68:4f:3e:8f:fc root@hdp02.dbinterest.local
  60. The key's randomart image is:
  61. +--[ RSA 2048]----+
  62. |                 |
  63. |                 |
  64. |    .            |
  65. |   +     .       |
  66. |  o o   S        |
  67. | o o o o         |
  68. |+ ..* o          |
  69. |+.o=o=           |
  70. |.o oB=E          |
  71. +-----------------+
  72. [root@hdp02 ~]# ssh-copy-id -i /root/.ssh/id_rsa.pub hdp01
  73. The authenticity of host 'hdp01 (192.168.1.121)' can't be established.
  74. RSA key fingerprint is 23:fa:69:0b:a5:b0:c2:80:13:13:ba:2b:7d:b1:5b:ff.
  75. Are you sure you want to continue connecting (yes/no)? yes
  76. Warning: Permanently added 'hdp01,192.168.1.121' (RSA) to the list of known hosts.
  77. root@hdp01's password: 
  78. Now try logging into the machine, with "ssh 'hdp01'", and check in:

  80.   .ssh/authorized_keys

  82. to make sure we haven't added extra keys that you weren't expecting.


  85. ###########################################################
  86. Generating RSA keys for all OTHER hosts...
  87. hostname is hdp03
  88. ###########################################################

  90. spawn ssh root@hdp03
  91. The authenticity of host 'hdp03 (192.168.1.123)' can't be established.
  92. RSA key fingerprint is 23:fa:69:0b:a5:b0:c2:80:13:13:ba:2b:7d:b1:5b:ff.
  93. Are you sure you want to continue connecting (yes/no)? yes
  94. Warning: Permanently added 'hdp03,192.168.1.123' (RSA) to the list of known hosts.
  95. root@hdp03's password: 
  96. Last login: Tue Sep 18 02:09:19 2012 from hdp02.dbinterest.local
  97. [root@hdp03 ~]# ssh-keygen -t rsa -P '' -f /root/.ssh/id_rsa
  98. Generating public/private rsa key pair.
  99. Created directory '/root/.ssh'.
  100. Your identification has been saved in /root/.ssh/id_rsa.
  101. Your public key has been saved in /root/.ssh/id_rsa.pub.
  102. The key fingerprint is:
  103. a4:3d:dd:54:42:c0:45:ec:ed:ae:d6:bd:14:a0:9b:16 root@hdp03.dbinterest.local
  104. The key's randomart image is:
  105. +--[ RSA 2048]----+
  106. |         ..*= .  |
  107. |          . .o   |
  108. |        .  ..o   |
  109. |       + . oo o  |
  110. |      . S .E.. . |
  111. |         .  + . .|
  112. |           + o o |
  113. |          . . + .|
  114. |           ... ..|
  115. +-----------------+
  116. [root@hdp03 ~]# ssh-copy-id -i /root/.ssh/id_rsa.pub hdp01
  117. The authenticity of host 'hdp01 (192.168.1.121)' can't be established.
  118. RSA key fingerprint is 23:fa:69:0b:a5:b0:c2:80:13:13:ba:2b:7d:b1:5b:ff.
  119. Are you sure you want to continue connecting (yes/no)? yes
  120. Warning: Permanently added 'hdp01,192.168.1.121' (RSA) to the list of known hosts.
  121. root@hdp01's password: 
  122. Now try logging into the machine, with "ssh 'hdp01'", and check in:

  124.   .ssh/authorized_keys

  126. to make sure we haven't added extra keys that you weren't expecting.

  128. [root@hdp03 ~]# 
  129. ############################################################################
  130. Copying authorized_keys to host hdp02 from the MASTER host hdp01...
  131. ############################################################################

  133. spawn scp /root/.ssh/authorized_keys root@hdp02:/root/.ssh/
  134. root@hdp02's password: 
  135. authorized_keys                                                                                            100% 1227     1.2KB/s   00:00    

  137. ############################################################################
  138. Copying authorized_keys to host hdp03 from the MASTER host hdp01...
  139. ############################################################################

  141. spawn scp /root/.ssh/authorized_keys root@hdp03:/root/.ssh/
  142. root@hdp03's password: 
  143. authorized_keys                                                                                            100% 1227     1.2KB/s   00:00    

  145. ############################################################################
  146. Distributing the /root/sshslaves file to slave host hdp02...
  147. ############################################################################

  149. sshslaves                                                                                                  100%   12     0.0KB/s   00:00    

  151. ############################################################################
  152. Distributing the /root/ssh4slaves.sh script to slave host hdp02...
  153. ############################################################################

  155. ssh4slaves.sh                                                                                              100% 1277     1.3KB/s   00:00    

  157. ############################################################################
  158. Distributing the /root/sshslaves file to slave host hdp03...
  159. ############################################################################

  161. sshslaves                                                                                                  100%   12     0.0KB/s   00:00    

  163. ############################################################################
  164. Distributing the /root/ssh4slaves.sh script to slave host hdp03...
  165. ############################################################################

  167. ssh4slaves.sh                                                                                              100% 1277     1.3KB/s   00:00    

  169. ############################################################################
  170. Working on the slaves node hdp02 to ensure no prompt for the yes/no question...
  171. ############################################################################


  174. Ensure ssh passwordless works among all slave nodes...

  176. spawn ssh root@hdp02
  177. The authenticity of host 'hdp02 (192.168.1.122)' can't be established.
  178. RSA key fingerprint is 23:fa:69:0b:a5:b0:c2:80:13:13:ba:2b:7d:b1:5b:ff.
  179. Are you sure you want to continue connecting (yes/no)? yes
  180. Warning: Permanently added 'hdp02,192.168.1.122' (RSA) to the list of known hosts.
  181. Last login: Tue Sep 18 02:11:54 2012 from hdp01.dbinterest.local
  182. [root@hdp02 ~]# 
  183. Ensure ssh passwordless works among all slave nodes...

  185. spawn ssh root@hdp03
  186. The authenticity of host 'hdp03 (192.168.1.123)' can't be established.
  187. RSA key fingerprint is 23:fa:69:0b:a5:b0:c2:80:13:13:ba:2b:7d:b1:5b:ff.
  188. Are you sure you want to continue connecting (yes/no)? yes
  189. Warning: Permanently added 'hdp03,192.168.1.123' (RSA) to the list of known hosts.
  190. Last login: Tue Sep 18 02:11:55 2012 from hdp01.dbinterest.local
  191. [root@hdp03 ~]# 
  192. ############################################################################
  193. Working on the slaves node hdp03 to ensure no prompt for the yes/no question...
  194. ############################################################################


  197. Ensure ssh passwordless works among all slave nodes...

  199. spawn ssh root@hdp02
  200. The authenticity of host 'hdp02 (192.168.1.122)' can't be established.
  201. RSA key fingerprint is 23:fa:69:0b:a5:b0:c2:80:13:13:ba:2b:7d:b1:5b:ff.
  202. Are you sure you want to continue connecting (yes/no)? yes
  203. Warning: Permanently added 'hdp02,192.168.1.122' (RSA) to the list of known hosts.
  204. Last login: Tue Sep 18 02:11:58 2012 from hdp02.dbinterest.local
  205. [root@hdp02 ~]# 
  206. Ensure ssh passwordless works among all slave nodes...

  208. spawn ssh root@hdp03
  209. The authenticity of host 'hdp03 (192.168.1.123)' can't be established.
  210. RSA key fingerprint is 23:fa:69:0b:a5:b0:c2:80:13:13:ba:2b:7d:b1:5b:ff.
  211. Are you sure you want to continue connecting (yes/no)? yes
  212. Warning: Permanently added 'hdp03,192.168.1.123' (RSA) to the list of known hosts.
  213. Last login: Tue Sep 18 02:11:59 2012 from hdp02.dbinterest.local

  215. ############################################################################
  216. Check whether the Passwordless SSH works for hdp01...
  217. ############################################################################

  219. Linux hdp01.dbinterest.local 2.6.32-279.el6.x86_64 #1 SMP Fri Jun 22 12:19:21 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
  220. Tue Sep 18 02:12:05 PDT 2012

  222. ############################################################################
  223. Check whether the Passwordless SSH works for hdp02...
  224. ############################################################################

  226. Linux hdp02.dbinterest.local 2.6.32-279.el6.x86_64 #1 SMP Fri Jun 22 12:19:21 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
  227. Tue Sep 18 02:12:05 PDT 2012

  229. ############################################################################
  230. Check whether the Passwordless SSH works for hdp03...
  231. ############################################################################

  233. Linux hdp03.dbinterest.local 2.6.32-279.el6.x86_64 #1 SMP Fri Jun 22 12:19:21 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
  234. Tue Sep 18 02:12:06 PDT 2012
复制代码
5. 其他节点测试
  1. [root@hdp02 ~]# 
  2. [root@hdp02 ~]# ssh hdp02
  3. Last login: Tue Sep 18 02:12:00 2012 from hdp03.dbinterest.local
  4. [root@hdp02 ~]# exit
  5. logout
  6. Connection to hdp02 closed.
  7. [root@hdp02 ~]# ssh hdp03
  8. Last login: Tue Sep 18 02:12:02 2012 from hdp03.dbinterest.local
  9. [root@hdp03 ~]# exit
  10. logout
  11. Connection to hdp03 closed.
  12. [root@hdp02 ~]# 

  14. ----------

  16. [root@hdp03 ~]# 
  17. [root@hdp03 ~]# ssh hdp01
  18. Last login: Tue Sep 18 02:12:22 2012 from hdp02.dbinterest.local
  19. [root@hdp01 ~]# exit
  20. logout
  21. Connection to hdp01 closed.
  22. [root@hdp03 ~]# ssh hdp02
  23. Last login: Tue Sep 18 02:12:25 2012 from hdp02.dbinterest.local
  24. [root@hdp02 ~]# exit
  25. logout
  26. Connection to hdp02 closed.
  27. [root@hdp03 ~]# ssh hdp03
  28. Last login: Tue Sep 18 02:12:30 2012 from hdp02.dbinterest.local
  29. [root@hdp03 ~]# exit
  30. logout
  31. Connection to hdp03 closed.
  32. [root@hdp03 ~]#
复制代码



sshconfig.zip

自动化
著作权归作者所有

如果觉得我的文章对您有用，请点赞。您的支持将鼓励我继续创作！

赞1

添加新评论0 条评论

Ctrl+Enter 发表

作者其他文章

  • 《好好学习：个人知识管理精进指南》读书笔记一
    评论 0 · 赞 4
  • 20200320关于灾备的一些随笔
    评论 0 · 赞 2
  • 突然又想开始写点东西了
    评论 1 · 赞 2
  • 20200321多注意休息多喝水
    评论 0 · 赞 0
  • 解决“ORA-04030: 在尝试分配 64544 字节 (sort subheap,sort key) 时进程内存不足”
    评论 0 · 赞 0

    • 相关文章

  • 城商行如何基于多云云管平台实现资源管理自动化及标准化总结
  • 乐山市商业银行总部信息科技部社会招聘 地域：乐山市

    • 相关资料

  • Python 自动化运维 100个常见问题
  • 【实用】279个开箱即用的shell脚本
  • Ansible基础知识学习
  • 城商行如何基于多云云管平台建设实践

    • 关于TWT使用指南社区专家合作厂商入驻社区企业招聘投诉建议版权与免责声明联系我们
    © 2024talkwithtrend — talk with trend,talk with technologist京ICP备09031017号-30

    X社区推广