Projects

Projects using MITK

• The Computer Graphics & Visualization Lab at the Korea Advanced Institute of Science and Technology uses MITK in several projects
• The Centre for Medical Image Computing at the University College London has created NiftyView, a MITK-based working environment for clinical collaborators and research scientists Read more...

MBI-based projects

All projects of the Department of Medical and Biological Informatics at the German Cancer Research Center use MITK for their software development. An overview can be found there.

Automated landmark detection and segmentation for intra-operative C-Arm CT applications

[[Media:Projects$HeelBones.png|Screenshot|of 3D c-arms image of heel bone|width="80",align="right"]]

With the development of mobile 3D C-arms, complex bone structures can be visualized during surgery. We design algorithms that facilitate the usability of a mobile 3D imaging system and provide an automatic assessment of a surgical procedure. Thus, working with the imaging system will be faster and allows surgeons to operate with a higher accuracy.

---

Mitral Valve Modeling based on 4D TEE Data

[[Media:Projects$MitralValveModeling.png|Screenshot|of mitral valve modeling project|width="250",align="right"]]

In mitral valve surgery, the 4D transesophageal echocardiogram has become a standard imaging procedure. Yet, the enormous amount of data produced by this method is hardly exploited because of a lack of respective algorithms. In this project, 4D TEE sequences are used to generate a mathematical model of the mitral valve. This model can be used to perform precise measurements to quantify irregularities, to determine the success after a surgical operation or to compare different patients and treatments. Read more ...

---

Simulation of Congenital Heart Defect Corrective Surgeries Using Thin Shell Elements

[[Media:Projects$CongenitalHeartDefect.jpg|Screenshot|of Simulation of Congenital Heart Defect|width="250",align="right"]]

We want to improve surgery planning by providing a simulation system that is able to accurately predict patient-specific results for different surgical procedures preoperatively. Therefore we use a sophisticated simulation model based on thin shell elements and developed a novel mesh joining approach that allows for implementing all necessary surgical low-level procedures, e.g. incising and suturing, independent from the simulation model. Read more ...

---

Quantification of Whole-Body Adipose Tissue

[[Media:Projects$AdiposeTissueAnalysis.jpg|Screenshot|of adipose tissue analyse|width="250",align="right"]]

Investigations of prospective studies on the role of overweight and obesity are based mostly on simple metrics such as Body Mass Index (BMI) or waist circumference. The distribution of adipose tissue, which cannot be determined by these simple metrics, is correlated to metabolic syndromes of obesity. For a while, whole-body magnetic resonance imaging (MRI) has been used for a precise assessment of adipose tissue. Compared to the simple metrics, MRI provides an exact amount and the distribution of fat tissue. However, the major advantage of this data is the possibility to quantify the amount of different types of adipose tissue. Three kinds of fat can be distinguished: total, subcutaneous, and visceral adipose tissue. Read more ...

---

Augmented Reality Navigation System for Laparoscopic Prostatectomy

[[Media:Projects$LaparoscopicProstatectomy.png|Screenshot|of Augmented Reality visualization during laparoscopic prostatectomy|width="250",align="right"]]

In laparoscopic radical prostatectomy (LRP) an accurate preparation near the organ may spare the patient’s pelvic innervation and consequently preserve urinal continence and sexual potency. To support the dissection of the prostate an Augmented Reality (AR) Navigation System which conveys virtual organ models generated from transrectal ultrasonography (TRUS) onto the real endoscopic video during radical prostatectomy was created using MITK. The system utilizes custom-developed needles with colored heads which are inserted into the prostate as soon as the organ surface is uncovered. A 3D TRUS scan is acquired right after the placement of the needles and processed using MITK segmentation framework to delineate the important structures (nerve bundles, urethra, etc.). Furthermore, the heads of the needles are located in the 3D ultrasound using the interactive point setting tools in MITK. Thereafter, the system traces the navigation aids in real-time and correctly superimposes the TRUS-based 3D information on an additional AR monitor placed next to the normal endoscopic screen. As a result, the surgeon is provided with valuable information of hidden structures and enables a safe and efficient resection of the prostate. Read more ...

Related publication: Simpfendörfer T, Baumhauer M, Müller M, Gutt CN, Meinzer HP, Rassweiler JJ, Guven S, Teber D. Augmented reality visualization during laparoscopic radical prostatectomy. Journal of Endourology, Volume 25, 2011

---

MITK Diffusion Imaging

The Diffusion Imaging component of MITK encapsulates several projects which complement each other. The combined aim of these projects is the processing and visualization of diffusion weighted MR images of the brain as well as their analysis. It encompasses the research of the Neuroimaging Group in the Division Medical and Biological Informatics at the German Cancer Research Center (dkfz).

One aim is to provide an application, which showcases our developments as well as provides a stable base for further research with collaborations. This application can be found at DiffusionImaging.

Related publication: Fritzsche KH, Neher PF, Reicht I, van Bruggen T, Goch C, Reisert M, Nolden M, Zelzer S, Meinzer HP, Stieltjes B. MITK Diffusion Imaging. Methods of Information in Medicine, 2012.

Model Reconstruction

The emergence of diffusion MRI has provided a novel technique for probing the structural architecture of the human brain. Due to clinical and physical constraints these images have a limited spatial resolution as well as non negligible noise levels. We developed techniques using high angular diffusion images as well as Q-Ball reconstruction to increase the information which can be derived using diffusion MRI.

Related publication: Fritzsche KH, Meinzer HP. Numerical Q-Ball Image Reconstruction: an ITK Implementation. The Insight Journal 2009.

Quantification

Due to the complexity of diffusion images and the contained information advanced techniques are required to interpret them. We use a variety of indicators and methods to analyse these images ranging from simple f- and d-maps to intra-voxel incoherent motion (IVIM) as well as tract-based spatial statistics (TBSS).

Fiber Tractography

The diffusion information can be used to model the structural connections within the human brain. The models are constrained by noisy data, the inherent physical limitations of the imaging technique as well as limited gold standards for comparison. We develop a global tractography approach, which has been compared to other state of the art methods in several challenges and was shown to perform better than most of them. We furthermore develop an evaluation framework to provide an objective way of evaluating the performance of tracking algorithms according to several criterias.

Related publication: Neher PF, Stieltjes B, Meinzer HP, Fritzsche KH. Introduction of a Quantitative Evaluation Method for White Matter Tractography using a HARDI-based Reference. Workshop on Computational Diffusion MRI (MICCAI), 2012.

Connectomics

Fiber tractography images provide valuable information about the structural pathways within the brain. Due to their nature they can not easily be used to compare the structure of the pathway system between patients. By abstracting the connections within the brain into a graph representation, the connectome, we can use graph measures to quantify the changes between a healthy brain and one suffering from a disease, such as an autism spectrum disorder.

Read more ...

---

Computer-assisted percutaneous needle insertion

[[Media:Projects$NeedleInsertion.jpg|Needle|insertion|width="200",align="right"]]

Percutaneous needle insertions are widely applied in clinical routine to e.g. perform biopsies or radiofrequency ablation (RFA). For those, a needle-shaped instrument is inserted through the skin into the target organ. The success of the needle insertion crucially depends on the ability of the physician to correctly transfer the pre-defined insertion trajectory to the patient. The main challenges include the trajectory planning which is conventionally performed on the 2D slices of the computed tomography (CT) volume, the transfer of the planned trajectory to the actual situation at the patient (registration), the consideration of movements and deformation e.g. through respiration (motion compensation) and an appropriate visualization during the targeting procedure. Several projects have been realized with the use of MITK that aim at providing methods for computer-assisted needle insertion. These will be described in the following.

Trajectory planning

Media:Projects$ablation1.jpg|Ablation|planning|width="200",align="right"

For the planning step, an automatic trajectory planning system was developed that allows for efficient calculation of safe insertion trajectories without needing the user to specify priorizations regarding the constraints to the trajectory [1]. Hard constraints to the path (e.g. that the trajectory must not intesect any critical structure) and soft constraints allowing to rate the possible trajectories (e.g. the distance of the trajectory to the closest critical structure) are realized as filter classes and processed in a pipeline structure with MITK. To determine a proposal of suitable trajectories without needing manual prioritization of these soft constraints, a pareto optimization is performed. The underlying segmentations of the critical structures, the target, the organ and the patient's skin from the CT data are created using the segmentation methods provided by MITK.

Related publication: Seitel, A. et al., "Computer-assisted trajectory planning for percutaneous needle insertions", Med.Phys. 38(6), 2011

Motion compensation and computer guidance

[[Media:Projects$NeedleNavigationVisualization.jpg|Navigation|visualization|width="200",align="right"]]

The accurate placement of the needle in soft tissue interventions requires adequate registration, motion compensation and guidance approaches. A first marker-based navigation prototype has been developed within MITK and yielded an accuracy in the magnitude of 3 mm in an in-vivo setting [2]. Optically or magnetically tracked fiducial needles are inserted into the target organ close to the target and are used both for registration and motion compensation. Appropriate visualization techniques for guidance were developed together with experienced interventional radiologists. The whole navigation workflow in this prototype is realized by using the image-guided therapy module (MITK-IGT) and is thus flexible regarding its individual steps (planning, registration, motion compensation, guidance) [3].

Related publication: Maier-Hein, L. et al., "In-vivo accuracy assessment of a needle-based navigation system for CT-guided radiofrequency ablation of the liver", Med.Phys. 35(12), 2008

Markerless navigation

[[Media:Projects$MarkerlessVisualization.jpg|Markerless|navigation|width="200",align="right"]]

Marker-based navigation approaches for percutaneous needle insertions have not become widely accepted in clinical routine so far, because their benefit to the patient could not exceed the additional hardware complexity and additional higher costs. To address this, a markerless navigation concept has been introduced that uses with the Time-of-Flight (ToF) camera only one single modality for patient localization and instrument guidance. The surfaces acquired by the ToF camera are used for registration, the intensity images provided by the camera for guidance. The whole markerless navigation workflow is mapped into a pipeline structure using the modules for range imaging within MITK (MITK-ToF).

Ultrasound-guided navigated needle insertion

While the majority of the complicated needle insertions is still performed under CT-guidance, ultrasound (US)-guided procedures feature many advantages such as low costs, high availability, and no radiation exposure. However, US-guidance is mainly performed in an in-plane manner such that visualization of critical structures relatively to the needle position is difficult. In this project a novel mobile EM field generator is mounted at the US probe to allow tracking of the needle relatively to the US image. Thus critical structures can be highlighted in the image and the needle can be continuosly visualized. Here, MITK-IGT is also used for building the navigation pipeline. The real-time acquisition of the US data is achieved within the US module of MITK.

Read more...

---

Using MITK for Augmented Reality Navigation on Mobile Devices

[[Media:Projects$TabletNavigation.jpg|Screenshot|of tablet navigation during percutaneous nephrolithotomy|width="250",align="right"]]

On basis of MITK an Augmented Reality (AR) navigation system was developed which utilizes a conventional tablet PC to superimpose a transparent, virtual model of a patient gained from CT images onto the video stream recorded by the tablet's camera. As a result, a virtual insight into the patient is generated. The real-time registration of the 2D video images with the 3D CT content is done utilizing radio-dense, colored markers, easily detectable in both imaging modalities. After affixing the markers on the patient's skin, a CT scan is performed. Prior to the intervention, the CT image is segmented using the MITK interactive segmentation tools to create a three-dimensional, virtual model of the patient. The tablet is equipped with MITK MES (MITK for mobile devices) which was recently developed. The tablet captures images of the surgical site and sends them via Wi-Fi to a tracking server which runs the MITK Workbench. The Workbench in turn runs the registration routines and creates and sends the rendered AR images back to the tablet where they are displayed. The system is currently evaluated in percutaneous nephrolithotomy which is a procedure to remove kidney stones.

Related publication: Rassweiler JJ, Müller M, Fangerau M, Klein J, Goezen AS, Pereira P, Meinzer HP, Teber D. iPad-Assisted Percutaneous Access to the Kidney Using Marker-Based Navigation: Initial Clinical Experience. European Urology, 2012.

---

Statistical tracking of tree-like tubular structures

[[Media:Projects$TrackingTubularStructure.png|Screenshot|of vessel segmentation|width="250",align="right"]]

The segmentation of tubular structures from 3D medical image data is the essential basis for many computer-assisted applications such as operation planning and the development of an individualized ventilation strategy. Our project has as its objective the development of a robust segmentation procedure to achieve precise results with few user interactions in a clinically feasible amount of time. Read more ...

---

Navigated Bronchoscopy

[[Media:Projects$NavigatedBronchoscopy.png|Screenshot|of TBNA |width="250",align="right"]]

Bronchoscopic interventions, such as transbronchial needle aspiration (TBNA), are commonly performed procedures to diagnose and stage lung cancer. However, due to the complex structure of the lung, one of the main challenges is to find the exact position to perform a biopsy and to actually hit the biopsy target. To overcome this problem an image-guided, electromagnetic navigation system for transbronchial interventions was developed. Utilizing MTIK and MITK-IGT, the system provides real time positioning information for the bronchoscope and a transbronchial biopsy instrument with only one preoperatively acquired computed tomography image. A twofold respiratory motion compensation method based on a particle filtering approach further allows for guidance through the entire respiratory cycle. Read more ...

Related publication: Gergel I, Gaa J, Müller M, Meinzer HP, Wegner I. A novel fully automatic system for the evaluation of electromagnetic tracker. In: Medical Imaging 2012: Image-Guided Procedures, Robotic Interventions, and Modeling / David R. Holmes III, Kenneth H. Wong, SPIE Bellingham, Washington, 2012.

---

Dynamic Analysis of Respiratory Movement

Media:Projects$Lung.png|Screenshot|of vector field representing a portion of lung motion|width="150",align="right"

In the course of numerous lung diseases, and following therapy, a reduction in respiratory motion and thus restricted pulmonary function is observed. New imaging techniques have recently provided non-invasive methods for depicting these changes. The aim of the project is to establish the technical basis for analyzing respiratory motion using 3D+t magnetic resonance imaging or computed tomography. To this end, one of the approaches currently being followed is to define vector fields that approximately reflect the motion of lung parenchyma during the respiratory cycle. The analysis of the vector fields permits conclusions about the movement, within a local area, and deformation of tissue. When coded onto a color map, this information may be used, for instance, to track how successful a therapy is over time. Read more ...

---

The extensible open-source rigid and affine image registration module of the Medical Imaging Interaction Toolkit (MITK)

Media:Projects$stein-registration.jpeg|Screenshot|of registration module|width="250",align="right"

Although non-rigid registration methods are available or under development for many specific problems in medicine, rigid and affine registration is an important task that is often performed for pre-aligning images before using non-rigid registration. We present a free and open-source application for rigid and affine image registration, which is designed both for developers and for end-users. The application is based on the MITK and allows for inter-modality and intra-modality rigid 2D-2D and 3D-3D registration of medical images such as CT, MRI, or ultrasound. The framework as well as the application can be easily extended by adding new transforms, metrics and optimizers. Additionally, the framework provides the possibility to use image masks to restrict the evaluation of metric values by the optimizer on certain areas of the images.

Related publication: Stein D, Fritzsche KH, Nolden M, Meinzer HP, Wolf I. The extensible open-source rigid and affine image registration module of the Medical Imaging Interaction Toolkit (MITK). Comput Methods Programs Biomed, 2010 Oct.

---

Navigated renal access using electromagnetic tracking: an initial experience

[[Media:Projects$ToolPairNavigation.jpeg|Description|width="250",align="right"]] Navigation systems are promising tools for improving efficacy and safety in surgical endoscopy and other minimally invasive techniques. The aim of this study is to investigate electromagnetic tracking (EMT) for navigated renal access in a porcine model. For our proof-of-principle study we modified a recently established porcine ex vivo model. Via a ureteral catheter which was placed into the desired puncture site, a small sensor was introduced and located by electro magnetic tracking (EMT). Then, a tracked needle was guided into the collecting system in a ‘‘rendezvous’’ approach. A total of 90 renal tracts were obtained in six kidneys using EMT, with a maximum of three punctures allowed per intervention. For each puncture, number of attempts to success, final distance to probe, puncture time, and localization were assessed. We compared absolute and relative frequencies using the chi-square test and applied the Mann–Whitney U-test for continuous variables. No major problems were encountered performing the experiment. Access to the collecting system was successfully obtained after a single puncture in 91% (82/90) and within a second attempt in the remaining 9% (8/90). Thus, a 100% success rate was reached after a maximum of two punctures. With respect to other established techniques, the use of EMT seems to decrease the number of attempts and procedural time remarkably. This might contribute to greater safety and efficacy when applied clinically.

Related publication: Huber J, Wegner I, Meinzer HP, Hallscheidt P, Hadaschik B, Pahernik S, Hohenfellner M. Navigated renal access using electromagnetic tracking: an initial experience. In Surgical Endoscopy, 2010 Sept.