Intelligent Robotic Assembly Method of Spaceborne Equipment Based on Visual Guidance

  • JI Xuquan ,
  • WANG Junchen ,
  • ZHAO Jiangdi ,
  • ZHANG Xiaohui ,
  • SUN Zhen
Expand
  • 1. Robotics Institute, Beihang University, Beijing 100191;
    2. Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100083

Received date: 2018-01-24

  Revised date: 2018-06-19

  Online published: 2018-12-05

Abstract

At present, the installation of large spaceborne equipment is usually performed manually. That is because the equipment is expensive and fragile, in addition the assembly process is carried out in a semi-closed space and under non-direct vision condition. Assemble workers operate under human observation and oral instructions. Therefore, the process is usually laborious and inefficient. To overcome this difficulty, an intelligent robotic assembly method based on visual guidance is proposed. First, machine learning and binocular vision techniques are employed to achieve accurate position measurement between assemblies. Then, motion mapping between the vision space and robot space is calculated to transfer the required motion into the robot space by hand-eye calibration. Next, assembly path planning is performed by analyzing the interference condition between two assemblies. Finally, the assembly process is visualized using virtual reality techniques for safety monitoring. The whole assembly process can be completed automatically in less than several minutes. Assembly experiments using satellite and equipment models are carried out, and the assembly error is evaluated to be less than 0.3 mm, confirming the effectiveness of the proposed method.

Cite this article

JI Xuquan , WANG Junchen , ZHAO Jiangdi , ZHANG Xiaohui , SUN Zhen . Intelligent Robotic Assembly Method of Spaceborne Equipment Based on Visual Guidance[J]. Journal of Mechanical Engineering, 2018 , 54(23) : 63 -72 . DOI: 10.3901/JME.2018.23.063

References

[1] PENG C Z,YANG T,BAO X H,et al. Experimental free-space distribution of entangled photon pairs over 13 km:Towards satellite-based global quantum communication[J]. Physical Review Letters,2005,94(15):150501-159501.
[2] 王田苗,陶永. 我国工业机器人技术现状与产业化发展战略[J]. 机械工程学报,2014,50(9):1-13. WANG Tianmiao,TAO Yong. Research status and industrialization development strategy of Chinese industrial robot[J]. Journal of Mechanical Engineering,2014,50(9):1-13.
[3] 陈国良,黄心汉,周祖德. 微装配机器人系统[J]. 机械工程学报,2009,45(2):288-293. CHEN Guoliang,HUANG Xinhan,ZHOU Zude. Micro-assembly robot system[J]. Journal of Mechanical Engineering,2009,45(2):288-293.
[4] TZERANIS D,ISHIJIMA Y,DUBOWSKY S. On the manipulation of large flexible structural modules by robots mounted on large flexible structures[C]//' i-SAIRAS 2005'-The 8th International Symposium on Artificial Intelligence,Robotics and Automation in Space,2005,Germany,Munich. The Netherlands:ESA Publications Division,2005:72-79.
[5] AKIN D,ROBERTS B,RODERICK S,et al. MORPHbots:Lightweight modular self-reconfigurable robotics for space assembly,inspection,and servicing[M]. Space,2006.
[6] WEI H,CAI Y,LI H,et al. Sambot:A self-assembly modular robot for swarm robot[C]//Robotics and Automation (ICRA),2010 IEEE International Conference on,2005,USA,AK. USA:IEEE,2010:66-71.
[7] ZHAN Q,ZHANG Q,WANG S. Real-time motion planning method based on neural networks for multiple mobile robots[J]. Chinese Journal of Mechanical Engineering,2001,14(1):1-54.
[8] 胡冬冬,苏鑫鑫. 雷锡恩公司建成世界最先进的导弹总装厂[J]. 飞航导弹,2013(2):9-11. HU Dongdong,SU Xinxin. Raytheon Company built the world's most advanced missile assembly plant[J]. Winged Missiles Journal,2013(2):9-11.
[9] HUANG P,WANG M,MENG Z,et al. Attitude takeover control for post-capture of target spacecraft using space robot[J]. Aerospace Science & Technology,2016,51:171-180.
[10] TINGELSTAD L,CAPELLAN A,THOMESSEN T,et al. Multi-robot assembly of high-performance aerospace components[J]. IFAC Proceedings Volumes,2012,45(22):670-675.
[11] 张明,喻懋林,张玉生. 自动化技术在卫星天线高精度装配中的应用研究[J]. 航空制造技术,2013,440(20):26-29. ZHANG Ming,YU Maolin,ZHANG Yusheng. Research on satellite antenna assembly by applying automatic assembly technology[J]. Aeronautical Manufacturing Technology,2013,440(20):26-29.
[12] HERRERO H,PACHECO R,ALBERDI N,et al. Skills for vision-based applications in robotics application to aeronautics assembly pilot station[C]//IEEE Eurocon 2015-International Conference on Computer As A Tool,2015,Spain,Salamanca. USA:IEEE,2015:1-6.
[13] LEALI F,VERGNANO A,PINI F,et al. A workcell calibration method for enhancing accuracy in robot machining of aerospace parts[J]. International Journal of Advanced Manufacturing Technology,2016,85(1-4):47-55.
[14] ZHANG Z. A flexible new technique for camera calibration[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence,2000,22(11):1330-1334.
[15] FUSIELLO A,TRUCCO E,VERRI A. A compact algorithm for rectification of stereo pairs[J]. Machine Vision & Applications,2000,12(1):16-22.
[16] BENNETT S,LASENBY J. Chess-quick and robust detection of chessboard features[J]. Computer Vision & Image Understanding,2014,118(1):197-210.
[17] CORTES C,VAPNIK V. Support-vector networks[J]. Machine Learning,1995,20(3):273-297.
[18] BAY H,ESS A,TUYTELAARS T,et al. Speeded-up robust features (SURF)[J]. Computer Vision & Image Understanding,2008,110(3):346-359.
[19] LUCCHESE L,MITRA S K. Using saddle points for subpixel feature detection in camera calibration targets[C]//Circuits and Systems,2002. APCCAS '02. 2002 Asia-Pacific Conference on,2002,Indonesia,Bali. USA:IEEE,2002:191-195.
[20] SCHÖNEMANN P H. A generalized solution of the orthogonal Procrustes problem[J]. Psychometrika,1966,31(1):1-10.
[21] 王君臣,王田苗,杨艳,等. 非线性最优机器人手眼标定[J]. 西安交通大学学报,2011,45(9):15-20. WANG Junchen,WANG Tianmiao,YANG Yan,et al. Nonlinear optimal robot hand to eye calibration[J]. Journal of Xi'an Jiaotong University,2011,45(9):15-20.
[22] ZHANG Shuyou. Research of guidance technology for assembly modeling in virtual environment[J]. Chinese Journal of Mechanical Engineering,2001,14(2):139-143.
Outlines

/