Chinese Journal of Mechanical Engineering >

2018 , Vol. 31 >Issue 4: 76 - 76

DOI: https://doi.org/10.1186/s10033-018-0275-9

Review

A Review of Point Feature Based Medical Image Registration

  • Shao-Ya Guan ,
  • Tian-Miao Wang ,
  • Cai Meng ,
  • Jun-Chen Wang
展开
  • 1. School of Mechanical Engineering and Automation, Beihang University, Beijing 100191, China;
    2. Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100083, China;
    3. School of Astronautics, Beihang University, Beijing 100191, China

收稿日期: 2017-09-19

  网络出版日期: 2019-07-23

基金资助

Supported by the National Natural Science Foundation of China (Grant No. 61533016)

收起

A Review of Point Feature Based Medical Image Registration

  • Shao-Ya Guan ,
  • Tian-Miao Wang ,
  • Cai Meng ,
  • Jun-Chen Wang
Expand
  • 1. School of Mechanical Engineering and Automation, Beihang University, Beijing 100191, China;
    2. Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing 100083, China;
    3. School of Astronautics, Beihang University, Beijing 100191, China

Received date: 2017-09-19

  Online published: 2019-07-23

Supported by

Supported by the National Natural Science Foundation of China (Grant No. 61533016)

Fold

摘要

Point features, as the basis of lines, surfaces, and bodies, are commonly used in medical image registration. To obtain an elegant spatial transformation of extracted feature points, many point set matching algorithms (PMs) have been developed to match two point sets by optimizing multifarious distance functions. There are ample reviews related to medical image registration and PMs which summarize their basic principles and main algorithms separately. However, to data, detailed summary of PMs used in medical image registration in diferent clinical environments has not been published. In this paper, we provide a comprehensive review of the existing key techniques of the PMs applied to medical image registration according to the basic principles and clinical applications. As the core technique of the PMs, geometric transformation models are elaborated in this paper, demonstrating the mechanism of point set registration. We also focus on the clinical applications of the PMs and propose a practical classifcation method according to their applications in diferent clinical surgeries. The aim of this paper is to provide a summary of pointfeature-based methods used in medical image registration and to guide doctors or researchers interested in this feld to choose appropriate techniques in their research.

关键词： Medical image registration; Point set matching; Optimization; Assessment; Application

本文引用格式

Shao-Ya Guan , Tian-Miao Wang , Cai Meng , Jun-Chen Wang . A Review of Point Feature Based Medical Image Registration[J]. Chinese Journal of Mechanical Engineering, 2018 , 31(4) : 76 -76 . DOI: 10.1186/s10033-018-0275-9

Abstract

Point features, as the basis of lines, surfaces, and bodies, are commonly used in medical image registration. To obtain an elegant spatial transformation of extracted feature points, many point set matching algorithms (PMs) have been developed to match two point sets by optimizing multifarious distance functions. There are ample reviews related to medical image registration and PMs which summarize their basic principles and main algorithms separately. However, to data, detailed summary of PMs used in medical image registration in diferent clinical environments has not been published. In this paper, we provide a comprehensive review of the existing key techniques of the PMs applied to medical image registration according to the basic principles and clinical applications. As the core technique of the PMs, geometric transformation models are elaborated in this paper, demonstrating the mechanism of point set registration. We also focus on the clinical applications of the PMs and propose a practical classifcation method according to their applications in diferent clinical surgeries. The aim of this paper is to provide a summary of pointfeature-based methods used in medical image registration and to guide doctors or researchers interested in this feld to choose appropriate techniques in their research.

Key words： Medical image registration; Point set matching; Optimization; Assessment; Application

参考文献

[1] P Markelj, D Tomaževič, B Likar, et al. A review of 3D/2D registration methods for image-guided interventions. Medical Image Analysis, 2012, 16(3): 642-661.
[2] S Matl, R Brosig, M Baust, et al. Vascular image registration techniques: A living review. Medical Image Analysis, 2017, 35: 1-17.
[3] B Maiseli, Y Gu, H Gao. Recent developments and trends in point set registration methods. Journal of Visual Communication and Image Representation, 2017, 46: 95-106.
[4] P J Besl, N D McKay. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2): 239-256.
[5] F P Oliveira, J M Tavares. Medical image registration: a review. Comput. Methods Biomech. Biomed Engin., 2014, 17(2): 73-93.
[6] A Sotiras, C Davatzikos, N Paragios. Deformable medical image registration: A Survey. IEEE Transactions on Medical Imaging, 2013, 32(7): 1153-1190.
[7] A P James, B V Dasarathy. Medical image fusion: A survey of the state of the art. Information Fusion, 2014, 19: 4-19.
[8] T S Y Tang, R E Ellis, G Fichtinger. Fiducial registration from a single X-Ray image: a new technique for fluoroscopic guidance and radiotherapy. International Conference on Medical Image Computing and Computer-Assisted Intervention, Pittsburgh, USA, October 11-14, 2000: 502-511.
[9] A Schweikard, H Shiomi, J Adler. Respiration tracking in radiosurgery without fiducials. The International Journal of Medical Robotics and Computer Assisted Surgery, 2005, 1(2): 19-27.
[10] R I Whyte. Stereotactic radiosurgery for lung tumors. Seminars in Thoracic and Cardiovascular Surgery. 2010, 22(1): 59-66.
[11] Z Mu, D Fu, G Kuduvalli. A probabilistic framework based on hidden Markov model for fiducial identification in image-guided radiation treatments. IEEE Transactions on Medical Imaging, 2008, 27(9): 1288-1300.
[12] R Balachandran, R F Labadie, J M Fitzpatrick. Clinical determination of target registration error of an image-guided otologic surgical system using patients with bone-anchored hearing aids. SPIE, California, United States, February 25-March 2, 2007, 6509: 650930.
[13] S D Olabarriaga, M Breeuwer, W J Niessen. Minimum cost path algorithm for coronary artery central axis tracking in CT images. International Conference on Medical Image Computing and Computer-Assisted Intervention, Montreal, Canada, November 15-18, 2003: 687-694.
[14] A F Frangi, W J Niessen, K L Vincken, et al. Multiscale vessel enhancement filtering. International Conference on Medical Image Computing and Computer-Assisted Intervention, Boston, USA, July 27-30, 1998: 130-137.
[15] M Schaap, T Walsum, L Neefjes, et al. Robust shape regression for supervised vessel segmentation and its application to coronary segmentation in CTA. IEEE Transactions on Medical Imaging. 2011, 30(11): 1974-1986.
[16] M A Gülsün, H Tek. Robust vessel tree modeling. International Conference on Medical Image Computing and Computer-Assisted Intervention, New York, USA, September 6-10, 2008: 602-611.
[17] N Baka, C T Metz, C Schultz, et al. Statistical coronary motion models for 2D+t/3D registration of X-ray coronary angiography and CTA. Medical Image Analysis, 2013, 17(6): 698-709.
[18] C T Metz, M Schaap, S Klein, et al. Registration of 3D+t coronary CTA and monoplane 2D+t X-ray angiography. IEEE Transactions on Medical Imaging, 2013, 32(5): 919-931.
[19] D Ruijters, B M Romeny, P Suetens. Vesselness-based 2D-3D registration of the coronary arteries. International Journal of Computer Assisted Radiology and Surgery, 2009, 4(4): 391-397.
[20] D Rivest-Henault, H Sundar, M Cheriet. Non-rigid 2D/3D registration of coronary artery models with live fluoroscopy for guidance of cardiac interventions. IEEE Transactions on Medical Imaging, 2012, 31(8): 1557-1572.
[21] J Kim, J Lee, W C Jin, et al. Locally adaptive 2D-3D registration using vascular structure model for liver catheterization. Computers in Biology and Medicine, 2016, 70: 119-130.
[22] R Liao, Y Tan, H D Sun, et al. An efficient graph-based deformable 2D/3D registration algorithm with applications for abdominal aortic aneurysm interventions. International Workshop on Medical Imaging and Virtual Reality, Beijing, China, September 19-20, 2010: 561-570.
[23] H Lombaert, Y Sun, L Grady, et al. A multilevel banded graph cuts method for fast image segmentation. Tenth IEEE International Conference on Computer Vision (ICCV), Beijing, China, October 17-20, 2005: 259-265.
[24] K Palágyi, E Balogh, A Kuba, et al. A sequential 3D thinning algorithm and its medical applications. Biennial International Conference on Information Processing in Medical Imaging, Davis, USA, June 18-22, 2001: 409-415.
[25] S Habert, P Khurd, C H Chefd. Registration of multiple temporally related point sets using a novel variant of the coherent point drift algorithm: application to coronary tree matching. Medical Imaging: Image Processing, Florida, USA, February 10-12, 2013: 86690M.
[26] C V Stewart, C L Tsai, B Roysam. The dual-bootstrap iterative closest point algorithm with application to retinal mage registration. IEEE Transactions on Medical Imaging, 2003, 22(11): 1379-1394.
[27] D Wassermann, J Ross, G Washko, et al. Deformable registration of feature-endowed point sets based on tensor fields. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, Ohio, USA, June 24-27, 2014: 2729-2735.
[28] K Deng, J Tian, J Zheng, et al. Retinal fundus image registration via vascular structure graph matching. International Journal of Biomedical Imaging, 2010, 2010: 1-13.
[29] M Groher, T F Jakobs, N Padoy, et al. Planning and intraoperative visualization of liver catheterizations. Academic Radiology, 2007, 14(11): 1325-1340.
[30] C Liu, J Ma, Y Ma, et al. Retinal image registration via feature-guided Gaussian mixture model. Journal of the Optical Society of America A, 2016, 37(7): 1267-1276.
[31] G Wang, Z Wang, Y Chen, et al. Robust point matching method for multimodal retinal image registration. Biomedical Signal Processing and Control, 2015, 19: 68-76.
[32] J Chen, J Tian, N Lee, et al. A partial intensity invariant feature descriptor for multimodal retinal image registration. IEEE Transactions on Biomedical Engineering, 2010, 57(7): 1707-1718.
[33] G Yang, C V Stewart, M Sofka, et al. Registration of challenging image pairs: Initialization, estimation, and decision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(11): 1973-1989.
[34] M Fleute, S Lavallée. Nonrigid 3-D/2-D registration of images using statistical models. International Conference on Medical Image Computing and Computer-Assisted Intervention, Cambridge, UK, September 19-22, 1999: 138-147.
[35] X Zhen, H Chen, H Yan, et al. A segmentation and point-matching enhanced efficient deformable image registration method for dose accumulation between HDR CT images. Physics in Medicine and Biology, 2015, 60(7): 2981-3002.
[36] G Zheng, M Á G Ballester, M Styner, et al. Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and point distribution model. International Conference on Medical Image Computing and Computer-Assisted Intervention, Copenhagen, Denmark, October 1-6, 2006: 25-32.
[37] A Torsello, E Rodola, A Albarelli. Sampling relevant points for surface registration. International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), Hangzhou, China, May 16-19, 2011: 290-295.
[38] S D Billings, E M Boctor, R H Taylor. Iterative most-likely point registration (IMLP): A robust algorithm for computing optimal shape alignment, PLOS ONE, 2015, 10(3): e117688.
[39] D C Barratt, G Penney, C S Chan, et al. Self-calibrating ultrasound-to-CT bone registration. International Conference on Medical Image Computing and Computer-Assisted Intervention(MICCAI), Palm Springs, USA, October 26-29, 2005: 605-612.
[40] A Brounstein, I Hacihaliloglu, P Guy, et al. Towards real-time 3D US to CT bone image registration using phase and curvature feature based GMM matching. Medical Image Computing and Computer-Assisted Intervention(MICCAI), Toronto, Canada, September 18-22, 2011: 235-242.
[41] I Hacihaliloglu, B A Rounstein, P Guy, et al. 3D ultrasound-CT registration in orthopaedic trauma using GMM registration with optimized particle simulation-based data reduction. Medical Image Computing and Computer-Assisted Intervention(MICCAI), Nice, France, October 1-5, 2012: 82-89.
[42] G Penney, P Edwards, A King, et al. A stochastic iterative closest point algorithm (stochastICP). Medical Image Computing and Computer-Assisted Intervention(MICCAI), Utrecht, Netherlands, October 14-17, 2001: 762-769.
[43] S Granger, X Pennec. Multi-scale EM-ICP: A fast and robust approach for surface registration. European Conference on Computer Vision(ECCV), Copenhagen, Denmark, Jan 1-4, 2002: 418-432.
[44] A W Fitzgibbon. Robust registration of 2D and 3D point sets. Image and Vision Computing, 2003, 21(13): 1145-1153.
[45] J J Moré. The Levenberg-Marquardt algorithm: implementation and theory. Numerical Analysis, the University of Wisconsin-Madison, USA, May 22-24, 1978: 105-116.
[46] J Yang, H Li, D Campbell, et al. Go-ICP: A globally optimal solution to 3D ICP point-set registration. IEEE Transactions on Pattern Analysis and Machine Intelligence(PAMI), 2016, 38(11): 2241-2254.
[47] R A Mclaughlin, J Hipwell, D J Hawkes, et al. A comparison of a similarity-based and a feature-based 2-D-3-D registration method for neurointerventional use. IEEE Transactions on Medical Imaging, 2005, 24(8): 1058-1066.
[48] S Gold, C P Lu, A Rangarajan, et al. New algorithms for 2D and 3D point matching: Pose estimation and correspondence. Advances in Neural Information Processing Systems, Denver, USA, November 27-30, 1995: 957-964.
[49] Rangarajan A, Chui H, Mjolsness E, et al. A robust point-matching algorithm for autoradiograph alignment. Medical Image Analysis, 1997, 1(4): 379-398.
[50] Y Zheng, D Doermann. Robust point matching for nonrigid shapes by preserving local neighborhood structures. IEEE Transactions on Pattern Analysis and Machine Intelligence(PAMI), 2006, 28(4): 643-649.
[51] S Belongie, J Malik, J Puzicha. Shape context: A new descriptor for shape matching and object recognition. Advances in Neural Information Processing Systems, Vancouver, Canada, December 3-8, 2001: 831-837.
[52] S J Belongie, J Malik, J Puzicha. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(4): 509-522.
[53] M Urschler, J Bauer, H Ditt, et al. SIFT and shape context for feature-based nonlinear registration of thoracic CT images. Computer Vision Approaches to Medical Image Analysis(CVAMIA), 2006, 6: 73-84.
[54] L Huang, Z Li. Feature-based image registration using the shape context. International Journal of Remote Sensing, 2010, 31(8): 2169-2177.
[55] .M Leordeanu, M Hebert. A spectral technique for correspondence problems using pairwise constraints. Tenth IEEE International Conference on Computer Vision(ICCV), Beijing, China, October 17-20, 2005: 1482-1489.
[56] H Liu, S Yan. Common visual pattern discovery via spatially coherent correspondences. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, USA, June 13-18, 2010: 1609-1616.
[57] L Torresani, V Kolmogorov, C Rother. Feature correspondence via graph matching: Models and global optimization. European Conference on Computer Vision(ECCV), Marseille, France, October 12-18, 2008: 596-609.
[58] H Liu, S Yan. Robust graph mode seeking by graph shift. 27th International Conference on Machine Learning (ICML-10), Haifa, Israel, June 21-24, 2010: 671-678.
[59] S D Sousa, W G Kropatsch. Graph-based point drift: Graph centrality on the registration of point-sets. Pattern Recognition, 2015, 48(2): 368-379.
[60] S P Timoshenko, S K Woinowsky. Theory of plates and shells. McGraw-Hill, 1959.
[61] M Groher, D Zikic, N Navab. Deformable 2D-3D registration of vascular structures in a one view scenario. IEEE Transactions on Medical Imaging, 2009, 28(6): 847-860.
[62] P E Gill, W Murray, M H Wright. Practical optimization. London: Academic Press, 1981.
[63] B Jian, B C Vemuri. Robust point set registration using Gaussian mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(8): 1633-1645.
[64] A P Dempster, N M Laird, D B Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B (Methodological), 1977: 1-38.
[65] M S Yang, C Y Lai, C Y Lin. A robust EM clustering algorithm for Gaussian mixture models. Pattern Recognition, 2012, 45(11): 3950-3961.
[66] J Fan, J Yang, D Ai, et al. Convex hull indexed Gaussian mixture model (CH-GMM) for 3D point set registration. Pattern Recognition, 2016, 59: 126-141.
[67] D Campbell, L Petersson. An adaptive data representation for robust point-set registration and merging. IEEE International Conference on Computer Vision(ICCV), Santiago, Chile, December 7-13, 2015: 4292-4300.
[68] N Baka, C T Metz, C J Schultz, et al. Oriented Gaussian mixture models for non-rigid 2D/3D coronary artery registration. IEEE Transactions on Medical Imaging, 2014, 33(5): 1023-1034.
[69] A Myronenko, X Song, M A Carreira-Perpinán. Non-rigid point set registration: Coherent point drift. Advances in Neural Information Processing Systems, British Columbia, Canada, September 20-23, 2007: 1009-1016.
[70] A Myronenko, X Song. Point set registration: coherent point drift. IEEE Transactions on Pattern Analysis and Machine Intelligence(PAMI), 2010, 32(12): 2262-2275.
[71] L Peng, G Li, M Xiao, et al. Robust CPD algorithm for non-rigid point set registration based on structure information. PloS One, 2016, 11(2): e148483.
[72] J N Dupej, V C Kraj, N J Pelik. Low-rank matrix approximations for Coherent point drift. Pattern Recognition Letters, 2015, 52: 53-58.
[73] M Lu, J Zhao, Y Guo, et al. Accelerated coherent point drift for automatic three-dimensional point cloud registration. IEEE Geoscience and Remote Sensing Letters, 2016, 13(2): 162-166.
[74] M Lu, J Zhao, Y Guo, et al. A 3D point cloud registration algorithm based on fast coherent point drift. IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington, USA, October 14-16, 2014: 1-6.
[75] J Zhang, L Lian, J Lei, et al. Enhanced coherent point drift algorithm for remote sensing image registration. Journal of Applied Remote Sensing, 2015, 9(1): 095074.
[76] W H Press. Numerical recipes 3rd edition: The art of scientific computing. London: Cambridge university press, 2007.
[77] Y Khoo, A Kapoor. Non-iterative rigid 2D/3D point-set registration using semidefinite programming. IEEE Transactions on Image Processing, 2016, 25(7): 2956-2970.
[78] A L Almhdie, C Ger, M Deriche, et al. 3D registration using a new implementation of the ICP algorithm based on a comprehensive lookup matrix: Application to medical imaging. Pattern Recognition Letters, 2007, 28(12): 1523-1533.
[79] P Jannin, E Krupinski, S Warfield. Validation in medical image processing. IEEE Transactions on Medical Imaging, 2006, 25(11): 1405-1409.
[80] P Felzenszwalb, D Huttenlocher. Distance transforms of sampled functions. New York: Cornell University, 2004.
[81] Benincasa A B, Clements L W, Herrell S D, et al. Assessment of required intraoperative surface for accurate physical to image space registrations. Medical Physics, 2008, 35(9): 4251-4261.
[82] Cash D M, Miga M I, Glasgow S C, et al. Concepts and preliminary data toward the realization of image-guided liver surgery. Journal of Gastrointestinal Surgery, 2007, 11(7): 844-859.
[83] dos Santos T R, Seitel A, Kilgus T, et al. Pose-independent surface matching for intra-operative soft-tissue marker-less registration. Medical Image Analysis, 2014, 18(7): 1101-1114.
[84] Schmalz C, Forster F, Schick A, et al. An endoscopic 3D scanner based on structured light. Medical Image Analysis, 2012, 16(5): 1063-1072.
[85] C Meng, J Zhang, D Liu, et al. A remote-controlled vascular interventional robot: system structure and image guidance. International Journal of Medical Robotics & Computer Assisted Surgery, 2013, 9(2): 230-239.
[86] Maier-Hein L, Mountney P, Bartoli A, et al. Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery. Medical Image Analysis, 2013, 17(8): 974-996.
[87] F GAO, Y ZHOU, F R DU, et al. Algorithm of pretreatment on automobile body point cloud. Chinese Journal of Mechanical Engineering, 2007, 20(4): 71-74.
[88] S Rusinkiewicz, M Levoy. Efficient variants of the ICP algorithm. IEEE Third International Conference on 3-D Digital Imaging and Modeling, Quebec City, Canada, May 28- June 1, 2001: 145-152.
[89] K Zhang, X Z Li, J X Zhang. A robust point-matching algorithm for remote sensing image registration. IEEE Geoscience and Remote Sensing Letters, 2014, 11(2): 469-473.
[90] J Zhang, L Chen, X Wang, et al. Compounding local invariant features and global deformable geometry for medical image registration. PloS One, 2014, 9(8): e105815.
Options
文章导航

/

〈 〉

版权所有 © 《Chinese Journal of Mechanical Engineering》编辑部

技术支持：北京玛格泰克科技发展有限公司