Flexible Scanning Method by Integrating Laser Line Sensors with Articulated Arm Coordinate Measuring Machines

  • Zexiao Xie ,
  • Ping Yu ,
  • Hanlei Gong ,
  • Shukai Chi ,
  • Xiang Gao
Expand
  • College of Engineering, Ocean University of China, Qingdao, 266100, China

Received date: 2020-06-30

  Revised date: 2022-04-04

  Online published: 2023-04-24

Supported by

Supported by National Natural Science Foundation of China (Grant No. 42076192).

Abstract

Measuring and reconstructing the shape of workpieces have been considered as a fundamental step in both reverse engineering and product quality control. Owing to increasing structural complexity of recent products, measurements from multiple directions are typically required in current scanning techniques. Specifically, the plane structured light can be applied to measure one area of a part at a time, with an additional algorithm required to merge the collected data of each area. Alternatively, the line structured light sensor integrated on CNC machines or CMMs could also realize multi-view measurement. However, the system needs to be repeatedly calibrated at each new direction. This paper presents a flexible scanning method by integrating laser line sensors with articulated arm coordinate measuring machines (AACMM). Since the output of the laser line sensor is 2D raw data in the laser plane, our system model introduces an explicit transformation from the 2D sensor coordinate frame to the 3D base coordinate frame of the AACMM (i.e., the translation and rotation the of the 2D sensor coordinate in the sixth coordinate system of AACMM). To solve the model, the “conjugate pairs” are proposed and identified by measuring a fixed point (e.g., a sphere center). Moreover, a search algorithm is adopted to find the optimal solution, which noticeably boosts the model accuracy. The experimental results show that the error of the system is about 0.2 mm, which is caused by the error of the AACMM, the sensor error and the calibration error. By measuring a complicated part, the proposed system is proved to be flexible and facilitate, with the ability to measure a part expediently from any necessary direction. Furthermore, the proposed calibration method can also be used for robot hand-eye relationship calibration.

Cite this article

Zexiao Xie , Ping Yu , Hanlei Gong , Shukai Chi , Xiang Gao . Flexible Scanning Method by Integrating Laser Line Sensors with Articulated Arm Coordinate Measuring Machines[J]. Chinese Journal of Mechanical Engineering, 2022 , 35(5) : 116 -116 . DOI: 10.1186/s10033-022-00776-3

References

[1] T Segreto, A Bottillo, R Teti. Non-contact reverse engineering modeling for additive manufacturing of down scaled cultural artefacts. Procedia CIRP, 2017, 62: 481–486.
[2] K Kawazoe, T Kubota, Y Deguchi. Development of receiver optics for simplified 3D laser scanner composition. Measurement, 2019, 133: 124–132.
[3] J Liang, H D Zhao, F C Song. Development of a laser-based measuring system for the inner geometrical dimension of cylinder line. Results in Optics, 2020, 1: 1–8 .
[4] K J He, C Y Sui, T Y Huang. 3D Surface reconstruction of transparent objects using laser scanning with .LTFtF method. Optics and Lasers in Engineering, 2022, 148: 1–10.
[5] M Javaid, A Haleem, R P Singh, et al. Industrial perspectives of 3D scanning: Features, roles and its analytical applications. Sensors International, 2021, 2: 1–11.
[6] Y J Shen, X Zhang, Z Y Wang, et al. A robust and efficient calibration method for spot laser probe on CMM. Measurement, 2020, 154: 1–10.
[7] X Huang, Z Liu, J Zhao. Surface detection method with line structured light in complex environment. Optical Precision Engineering, 2016, 24 (10): 682–689.
[8] N Ravikumar, A Gooya, S Çimen, et al. Group-wise similarity registration of point sets using Student’s t-mixture model for statistical shape models. Medical Image Analysis, 2018, 44: 156–176.
[9] M Guislain, J Digne, R Chaine, et al. Fine scale image registration in large-scale urban LIDAR point sets. Computer Vision and Image Understanding, 2017, 157: 90–102.
[10] J H Sun, D L Ding, X Q Cheng, et al. Calibration of line-structured light vision sensor based on free-placed single cylindrical target. Optics and Lasers in Engineering, 2022, 152: 1–7.
[11] Z L Zhou, W Liu, Y X Wang, et al. A combined calibration method of a mobile robotic measurement system for large-sized components. Measurement, 2022, 189: 1–16.
[12] Y Li, Y J Fu, K J Zhong, et al. A virtual binocular line-structured light measurement method based on a plane mirror. Optics Communications, 2022, 510: 1–8 .
[13] S Zhang. Flexible and high-accuracy method for uni-directional structured light system calibration. Optics and Lasers in Engineering, 2021, 143: 1–5.
[14] X B Xu, Z W Fei, J Yang, et al. Line structured light calibration method and centerline extraction: A review. Results in Physics, 2020, 19: 1–17.
[15] Y H Li, B C Zhao, J B Zhou, et al. A universal method for the calibration of swing-scanning line structured light measurement system. Optik, 2021, 241: 1–10 .
[16] Z Z Wei, L J Cao, G J Zhang. A novel 1D target-based calibration method with unknown orientation for structured light vision sensor. Optics & Laser Technology, 2010, 42: 570–574.
[17] Z Y Shi, T Wang, J C Lin. A simultaneous calibration technique of the extrinsic and turntable for structured-light-sensor-integrated CNC system. Optics and Lasers in Engineering, 2021, 138: 1–11.
[18] Z X Xie, C G Zhang, Q M Zhang. A simplified method for the extrinsic calibration of structured-light sensors using a single-ball target. International Journal of Machine Tools and Manufacture, 2004, 44(11): 1197–1203.
[19] J Santolaria, J J Pastor, F J Brosed, et al. A one-step intrinsic and extrinsic calibration method for laser line scanner operation in coordinate measuring machines. Measurement Science and Technology, 2009, 20(4): 1–12.
[20] Z X Xie, X M Wang X, S K Chi. Simultaneous calibration of the intrinsic and extrinsic parameters of structured-light sensors. Optics and Lasers in Engineering, 2014, 58: 9–18.
[21] H Du, X Chen, J Xi, et al. Development and verification of a novel robot-integrated fringe projection 3D scanning system for large-scale metrology. Sensors, 2017, 17 (12): 2886.
[22] X J Pan, J Y Wu, Z L Li, et al. Self-calibration for linear structured light 3D measurement system based on quantum genetic algorithm and feature matching. Optik, 2020, 255: 1–10.
[23] J D Han, W F Lv, F Wang. 3D data registration method based on optical location tracking technology. Optical Precision Engineering, 2009, 17(1): 45–51.
[24] J Chen, X J Wu, Y Wang, et al. 3D shape modeling using a self-developed hand-held 3D laser scanner and an efficient HT-ICP point cloud registration algorithm. Optics & Laser Technology, 2013, 45: 414–423.
[25] S Yin, Y Ren, Y Guo, et al. Development and calibration of an integrated 3D scanning system for high-accuracy large-scale metrology. Measurement, 2014, 54(8): 65–76.
[26] S Sharifzadeh, I Biro, P Kinnell. Robust hand-eye calibration of 2D laser sensors using a single-plane calibration artefact. Robotics and Computer-Integrated Manufacturing, 2020, 61: 1–10.
[27] Y Qin, R K Kang, J S Sun. A fast self-calibration method of line laser sensors for on-machine measurement of honeycomb cores. Optics and Lasers in Engineering, 2022, 152: 1–14.
[28] H T Yu, Y Huang, D L Zheng. Three-dimensional shape measurement technique for large-scale objects based on line structured light combined with industrial robot. Optik, 2020, 202: 1–11.
Outlines

/