{"id":779606,"date":"2026-09-23T04:32:25","date_gmt":"2026-09-23T04:32:25","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/779606\/"},"modified":"2026-09-23T04:32:25","modified_gmt":"2026-09-23T04:32:25","slug":"rapid-patient-specific-neural-networks-for-x-ray-to-volume-registration","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/779606\/","title":{"rendered":"Rapid patient-specific neural networks for X-ray to volume registration"},"content":{"rendered":"

Unberath, M. et al. The impact of machine learning on 2D\/3D registration for image-guided interventions: a systematic review and perspective. Front. Robot. AI 8, 716007 (2021).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Yip, M. et al. Artificial intelligence meets medical robotics. Science 381, 141\u2013146 (2023).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Penney, G. P. et al. A comparison of similarity measures for use in 2D\/3D medical image registration. IEEE Trans. Med. Imaging 17, 586\u2013595 (1998).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Knaan, D. & Joskowicz, L. Effective intensity-based 2D\/3D rigid registration between fluoroscopic X-ray and CT. In Proc. International Conference on Medical Image Computing and Computer-Assisted Intervention (eds Ellis, R. E. & Peters, T. M.) 351\u2013358 (Springer, 2003).<\/p>\n

Grupp, R. B. et al. Automatic annotation of hip anatomy in fluoroscopy for robust and efficient 2D\/3D registration. Int. J. Comput. Assist. Radiol. Surg. 15, 759\u2013769 (2020).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Grimm, M., Esteban, J., Unberath, M. & Navab, N. Pose-dependent weights and domain randomization for fully automatic X-ray to CT registration. IEEE Trans. Med. Imaging 40, 2221\u20132232 (2021).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Mahesh, M., Ansari, A. J. & Mettler, F. A. Jr Patient exposure from radiologic and nuclear medicine procedures in the United States and worldwide: 2009\u20132018. Radiology 307, e221263 (2022).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Cornelis, F. H., Dzaye, O., Schoellnast, H. & Solomon, S. B. Imaging of interventional therapies in oncology: image guidance, robotics, and fusion systems. In Interventional Oncology (eds Fong, Y. et al.) 1\u201317 https:\/\/doi.org\/10.1007\/978-3-030-51192-0_19-1<\/a> (Springer, 2023).<\/p>\n

Jhawar, B. S., Mitsis, D. & Duggal, N. Wrong-sided and wrong-level neurosurgery: a national survey. J. Neurosurg. Spine 7, 467\u2013472 (2007).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Tonetti, J., Boudissa, M., Kerschbaumer, G. & Seurat, O. Role of 3D intraoperative imaging in orthopedic and trauma surgery. Orthop. Traumatol. Surg. Res. 106, S19\u2013S25 (2020).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Abumoussa, A. et al. Machine learning for automated and real-time two-dimensional to three-dimensional registration of the spine using a single radiograph. Neurosurg. Focus 54, E16 (2023).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Naik, R. R., Hoblidar, A., Bhat, S. N., Ampar, N. & Kundangar, R. A hybrid 3D-2D image registration framework for pedicle screw trajectory registration between intraoperative X-ray image and preoperative CT image. J. Imaging 8, 185 (2022).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Metz, C. T. et al. Patient specific 4D coronary models from ECG-gated CTA data for intra-operative dynamic alignment of CTA with X-ray images. In Proc. International Conference on Medical Image Computing and Computer-Assisted Intervention (eds Guang-Zhong, Y. et al.) 369\u2013376 (Springer, 2009).<\/p>\n

Wagner, M., Schafer, S., Strother, C. & Mistretta, C. 4D interventional device reconstruction from biplane fluoroscopy. Med. Phys. 43, 1324\u20131334 (2016).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Huynh, E. et al. Artificial intelligence in radiation oncology. Nat. Rev. Clin. Oncol. 17, 771\u2013781 (2020).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Kim, Y. et al. Telerobotic neurovascular interventions with magnetic manipulation. Sci. Robot. 7, eabg9907 (2022).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Gu, W., Gao, C., Grupp, R., Fotouhi, J. & Unberath, M. Extended capture range of rigid 2D\/3D registration by estimating Riemannian pose gradients. In Proc. International Workshop on Machine Learning in Medical Imaging (eds Liu, M. et al.) 281\u2013291 (Springer, 2020).<\/p>\n

Gopalakrishnan, V. & Golland, P. Fast auto-differentiable digitally reconstructed radiographs for solving inverse problems in intraoperative imaging. In Proc. Workshop on Clinical Image-Based Procedures (eds Chen, Y. et al.) 1\u201311 (Springer, 2022).<\/p>\n

Gao, C. et al. A fully differentiable framework for 2D\/3D registration and the projective spatial transformers. IEEE Trans. Med. Imaging 43, 275\u2013285 (2023).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Grupp, R. B. et al. Pose estimation of periacetabular osteotomy fragments with intraoperative X-ray navigation. IEEE Trans. Biomed. Eng. 67, 441\u2013452 (2019).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Bier, B. et al. Learning to detect anatomical landmarks of the pelvis in X-rays from arbitrary views. Int. J. Comput. Assist. Radiol. Surg. 14, 1463\u20131473 (2019).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Shrestha, P., Xie, C., Yoshii, Y. & Kitahara, I. Rayemb: arbitrary landmark detection in X-ray images using ray embedding subspace. In Proc. Asian Conference on Computer Vision (eds Cho, M. et al.) 665\u2013681 (Springer, 2024).<\/p>\n

Miao, S., Wang, Z. J. & Liao, R. A CNN regression approach for real-time 2D\/3D registration. IEEE Trans. Med. Imaging 35, 1352\u20131363 (2016).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Bui, M., Albarqouni, S., Schrapp, M., Navab, N. & Ilic, S. X-ray posenet: 6 DoF pose estimation for mobile X-ray devices. In Proc. 2017 IEEE Winter Conference on Applications of Computer Vision (WACV) 1036\u20131044 (IEEE, 2017).<\/p>\n

Zhang, B. et al. A patient-specific self-supervised model for automatic X-ray\/CT registration. In Proc. International Conference on Medical Image Computing and Computer-Assisted Intervention (eds Greenspan, H. et al.) 515\u2013524 (Springer, 2023).<\/p>\n

Gopalakrishnan, V., Dey, N. & Golland, P. Intraoperative 2D\/3D image registration via differentiable X-ray rendering. In Proc. IEEE\/CVF Conference on Computer Vision and Pattern Recognition 11662\u201311672 (IEEE, 2024).<\/p>\n

Wasserthal, J. et al. TotalSegmentator: robust segmentation of 104 anatomic structures in CT images. Radiol. Artif. Intell. 5, e230024 (2023).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n PubMed Central<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Jaus, A. et al. Towards unifying anatomy segmentation: automated generation of a full-body CT dataset. In Proc. 2024 IEEE International Conference on Image Processing (ICIP) 41\u201347 (IEEE, 2024).<\/p>\n

Magnetic Resonance Angiography Atlas Dataset. NeuroImaging Tools & Resources Collaboratory https:\/\/www.nitrc.org\/projects\/icbmmra<\/a> (2017).<\/p>\n

Liu, P. et al. Deep learning to segment pelvic bones: large-scale CT datasets and baseline models. Int. J. Comput. Assist. Radiol. Surg. 16, 749\u2013756 (2021).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Yushkevich, P. A. et al. Fast automatic segmentation of hippocampal subfields and medial temporal lobe subregions in 3 Tesla and 7 Tesla T2-weighted MRI. Alzheimers Dement. 12, P126\u2013P127 (2016).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Zhou, Y., Barnes, C., Lu, J., Yang, J. & Li, H. On the continuity of rotation representations in neural networks. In Proc. IEEE\/CVF Conference on Computer Vision and Pattern Recognition 5745\u20135753 (IEEE, 2019).<\/p>\n

Geist, A. R., Frey, J., Zhobro, M., Levina, A. & Martius, G. Learning with 3D rotations, a hitchhiker\u2019s guide to SO(3). In Proc. 41st International Conference on Machine Learning Vol. 235 (eds Salakhutdinov, R. et al.) 15331\u201315350 (PMLR, 2024).<\/p>\n

Lin, C., Hanson, A. J. & Hanson, S. M. Algebraically rigorous quaternion framework for the neural network pose estimation problem. In Proc. IEEE\/CVF International Conference on Computer Vision 14097\u201314106 (IEEE, 2023).<\/p>\n

He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proc. IEEE Conference on Computer Vision and Pattern Recognition 770\u2013778 (IEEE, 2016).<\/p>\n

Flepp, R. et al. Automatic multi-view X-ray\/CT registration using bone substructure contours. Int. J. Comput. Assist. Radiol. Surg. 20, 1401\u20131408 (2025).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Mitrovi\u0107, U., \u0160piclin, \u017d, Likar, B. & Pernu\u0161, F. 3D-2D registration of cerebral angiograms: a method and evaluation on clinical images. IEEE Trans. Med. Imaging 32, 1550\u20131563 (2013).<\/p>\n

Article<\/a>\u00a0
\n ADS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Xu, M. et al. VesselBoost: a Python toolbox for small blood vessel segmentation in human magnetic resonance angiography data. Aperture Neuro https:\/\/doi.org\/10.52294\/001c.123217<\/a> (2024).<\/p>\n

Ronneberger, O., Fischer, P. & Brox, T. U-net: convolutional networks for biomedical image segmentation. In Proc. International Conference on Medical Image Computing and Computer-Assisted Intervention (eds Navab, N. et al.) 234\u2013241 (Springer, 2015).<\/p>\n

Terzakis, G. & Lourakis, M. A consistently fast and globally optimal solution to the perspective-n-point problem. In Proc. European Conference on Computer Vision (eds Vedaldi, A. et al.) 478\u2013494 (Springer, 2020).<\/p>\n

Potente, M. & M\u00e4kinen, T. Vascular heterogeneity and specialization in development and disease. Nat. Rev. Mol. Cell Biol. 18, 477\u2013494 (2017).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Nu\u00f1ez, F. B. & Dohna-Schwake, C. Epidemiology, diagnostics, and management of vein of Galen malformation. Pediatr. Neurol. 119, 50\u201355 (2021).<\/p>\n

Article<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Varghese, C., Harrison, E. M., O\u2019Grady, G. & Topol, E. J. Artificial intelligence in surgery. Nat. Med. 30, 1257\u20131268 (2024).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Jena, R., Sethi, D., Chaudhari, P. & Gee, J. Deep learning in medical image registration: magic or mirage? In Proc. 38th Annual Conference on Neural Information Processing Systems (eds Globerson, A. et al.) 108331\u2013108353 (Curran Associates Inc., 2024).<\/p>\n

Dey, N. et al. Learning general-purpose biomedical volume representations using randomized synthesis. In Proc. 13th International Conference on Learning Representations (eds Yue, Y. et al.) (ICLR, 2025).<\/p>\n

Gagoski, B. et al. Automated detection and reacquisition of motion-degraded images in fetal HASTE imaging at 3T. Magn. Reson. Med. 87, 1914\u20131922 (2022).<\/p>\n

Article<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Arsigny, V., Commowick, O., Ayache, N. & Pennec, X. A fast and log-euclidean polyaffine framework for locally linear registration. J. Math. Imaging Vis. 33, 222\u2013238 (2009).<\/p>\n

Article<\/a>\u00a0
\n MathSciNet<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Gopalakrishnan, V., Dey, N. & Golland, P. PolyPose: deformable 2D\/3D registration via polyrigid transformations. In\u00a0Advances in Neural Information Processing Systems 60633\u201360659 (NeurIPS, 2025).<\/p>\n


\n Google Scholar<\/a>\u00a0\n <\/p>\n

Hartley, R. & Zisserman, A. Multiple View Geometry in Computer Vision (Cambridge Univ. Press, 2003).<\/p>\n

Swinehart, D. F. The Beer-Lambert law. J. Chem. Educ. 39, 333 (1962).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Siddon, R. L. Fast calculation of the exact radiological path for a three-dimensional CT array. Med. Phys. 12, 252\u2013255 (1985).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n PubMed<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Unberath, M. et al. DeepDRR\u2014a catalyst for machine learning in fluoroscopy-guided procedures. In Proc. International Conference on Medical Image Computing and Computer-Assisted Intervention (eds Frangi, A. F. et al.) 98\u2013106 (Springer, 2018).<\/p>\n

Milletari, F., Navab, N. & Ahmadi, S.-A. V-net: fully convolutional neural networks for volumetric medical image segmentation. In Proc. 2016 Fourth International Conference on 3D Vision (3DV) 565\u2013571 (IEEE, 2016).<\/p>\n

Grupp, R. B., Armand, M. & Taylor, R. H. Patch-based image similarity for intraoperative 2D\/3D pelvis registration during periacetabular osteotomy. In Proc. International Workshop on Computer-Assisted and Robotic Endoscopy 153\u2013163 (Springer, 2018).<\/p>\n

Ferrara, D. et al. Sharing a whole-\/total-body [18F] FDG-PET\/CT dataset with CT-derived segmentations: an ENHANCE.PET initiative. Sci. Data 13, 869 (2026).<\/p>\n

Sundar, L. K. S. et al. Fully automated, semantic segmentation of whole-body 18F-FDG PET\/CT images based on data-centric artificial intelligence. J. Nucl. Med. 63, 1941\u20131948 (2022).<\/p>\n

Article<\/a>\u00a0
\n CAS<\/a>\u00a0
\n
\n Google Scholar<\/a>\u00a0\n <\/p>\n

Grupp, R. et al. Data and code associated with the publication: Automatic annotation of hip anatomy in fluoroscopy for robust and efficient 2D\/3D registration. Johns Hopkins Research Data Repository https:\/\/doi.org\/10.7281\/T1\/IFSXNV<\/a> (2020).<\/p>\n

Flepp, R. et al.\u00a0Automatic multi-View X-Ray\/CT registration using bone substructure contours. Zenodo https:\/\/zenodo.org\/records\/15753063<\/a> (2025).<\/p>\n

Mitrovi\u0107, U. & \u0160piclin, \u017d. Gold standard for 3D-2D registration of cerebral angiograms. Laboratory of Imaging Technologies https:\/\/lit.fe.uni-lj.si\/en\/research\/resources\/3D-2D-GS-CA<\/a> (2013).<\/p>\n

Pengbo, L. et al. CTPelvic1K Dataset. Zenodo https:\/\/doi.org\/10.5281\/zenodo.4588402<\/a> (2020).<\/p>\n

Wasserthal, J. Dataset with segmentations of 117 important anatomical structures in 1228 CT images. Zenodo https:\/\/doi.org\/10.5281\/zenodo.6802613<\/a> (2023).<\/p>\n

Ferrara, D. et al. ENHANCE.PET 1.6k: a whole-\/total-body [18F]FDG-PET\/CT dataset with CT-derived segmentations. Science Data Bank https:\/\/doi.org\/10.57760\/sciencedb.34150<\/a> (2026).<\/p>\n

Paszke, A. et al. PyTorch: an imperative style, high-performance deep learning library. In Proc. 33rd International Conference on Neural Information Processing Systems (eds Wallach, H. M. et al.) 8026\u20138037 (Curran Associates Inc., 2019).<\/p>\n","protected":false},"excerpt":{"rendered":"Unberath, M. et al. The impact of machine learning on 2D\/3D registration for image-guided interventions: a systematic review…\n","protected":false},"author":2,"featured_media":779607,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[59,4230,4231,90,12278,56,54,55,256954],"class_list":["post-779606","post","type-post","status-publish","format-standard","has-post-thumbnail","category-science","tag-gb","tag-humanities-and-social-sciences","tag-multidisciplinary","tag-science","tag-translational-research","tag-uk","tag-united-kingdom","tag-unitedkingdom","tag-x-ray-tomography"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/779606","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=779606"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/779606\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/779607"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=779606"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=779606"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=779606"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}