3D Robotic Ultrasound

For diagnosis and treatment planning in orthopedics, e.g. total knee arthroplasty, 3D imaging is often required. Today’s standard for 3D image acquisition is CT or MRI. Both techniques cause high costs and CT emits harming radiation in addition. In contrast, ultrasound is commonly available at chairside, comes at low costs and does not expose the patient to radiation. Interpretation of ultrasound images however is a difficult task, in particular for volumetric images. Sonographer require years of experience to reliably detect the bone surface. Fast and precise diagnostics, e.g. of cruciate ligament rupture or periimplantitis, thus depends on automatic processing. We investigate the potential of robotic ultrasound scanning.

For image acquisition the robot moves along the region of interest while a contact force between the skin and the probe must be maintained. Challenges include robot control strategies as well as image processing for an accurate bone segmentation.

Latest research involves customized machine learning architectures for leveraging the spatial information: The transformer architecture, originally developed for natural language processing tasks, proofs to be a promising alternative to the convolutional neural network.

Figure: Scanning of bone dummy (left), initial 3D reconstruction of scanned bone dummy regions (right)

Figure: Fully automatic reconstruction of a distal femur bone from ultrasound: Image slices were segmented by a vision transformer architecture, the segmented partial 3D bone surface was completed using a statistical shape model (SSM).

Publications

  • B. Hohlmann, J. Glanz & K. Radermacher: Segmentation of the distal femur in ultrasound images. Current Directions in Biomedical Engineering, 6(1), 2020, pp. 1-5 [DOI: 10.1515/cdbme-2020-0034]
  • B. Hohlmann & K. Radermacher: Augmented Active Shape Model Search – towards 3D Ultrasound-based Bone Surface Reconstruction. In: F. Rodriguez Y Baena & F. Tatti (ed.): CAOS 2020. The 20th Annual Meeting of the International Society for Computer Assisted Orthopaedic Surgery, 4, 2020, pp. 117-121 [DOI: 10.29007/3px6]
  • B. Hohlmann & K. Radermacher: The interleaved partial active shape model (IPASM) search algorithm - towards 3D ultrasound-based bone surface reconstruction. In: P. Meere & F. Rodriguez Y Baena (ed.): CAOS 2019. The 19th Annual Meeting of the International Society for Computer Assisted Orthopaedic Surgery, 3, 2019, pp. 177-180 [DOI: 10.29007/rbgl]
  • C. Hänisch, B. Hohlmann & K. Radermacher: The interleaved partial active shape model search (IPASM) algorithm – Preliminary results of a novel approach towards 3D ultrasound-based bone surface reconstruction. In: K. Radermacher & F. Rodriguez Y Baena (ed.): CAOS2017. EPiC Series in Health Sciences, 1, 2017, pp. 399-406

Related topics

TOP