Edit this page

NA-MIC Project Weeks

Back to Projects List

Visualizing Brain Deformation

Key Investigators

Project Description

A 3D Slicer plug-in to visualize the dense quantification of brain shift as seen during MRI-ultrasound registration.

There are a few 3D Slicer plug-ins that allow the user to visualize the deformation field as either a vector field or a grid (such as Transform Visualizer), but there are a few shortcomings. Namely, 1) they don’t inherently function on ultrasound data (you must specify the deformation as either rigid, affine, or B-spline, none of which will work on ultrasound out of the box) and 2) they don’t quantify brain shift in millimetres, only in abstract vector fields.

We hope to do MRI-ultrasound registration and then densely quantify how much brain shift is present in millimetres at each voxel.

For the registration, we will implement a published and validated MRI-ultrasound registration pipeline from our lab [Rivaz, 2014] as a basis for non-rigid registration. Then we will use the resulting transformation to quantify how much brain shift (deformation) is occurring at each voxel and, as there should be a 1:1 mapping of the voxel space to the physical space, convert this deformation to millimetres. We would like to visualize this millimetre deformation in an intuitive way on both the slices and volumes to better understand where and how much deformation is occurring.

Objective

  1. Objective A. Implement a MRI-ultrasound registration pipeline as a 3D Slicer module for use on brain tumour resection data (validated on publicly available datasets such as RESECT, REMIND, and BITE)
  2. Objective B. Densely quantify how much deformation is present at each voxel in millimetres and visualize as a 3D Slicer module.

Approach and Plan

  1. Implement a previously published and validated registration pipeline from our lab for T1/ T2 MRI - B-mode ultrasound as a 3D Slicer module. Validate on publicly available datasets.
  2. Develop Slicer module that accepts a moving image (US), source image (MRI), and transformation (output from Step 1) to visualize the deformation field intuitively.
  3. Quantify how much deformation is present at each voxel using either mean curvature or gradient orientation information, or akin. Define conversion between voxel space and physical space to produce measure of deformation in millimetres.
  4. Output of the Slicer module will be the MRI and US volumes overlaid with an intuitive colour map representing deformation with 1) millimetre magnitude and 2) orientation.

Progress and Next Steps

  1. Started implementing registration pipeline as a 3D Slicer Module.

Illustrations

No response

Background and References

The registration method being implemented: Rivaz H, Karimaghaloo Z, Fonov VS, Collins DL. Nonrigid registration of ultrasound and MRI using contextual conditioned mutual information. IEEE Trans Med Imaging. 2014 Mar;33(3):708-25. doi: 10.1109/TMI.2013.2294630. PMID: 24595344.