Fakultät Informatik

Development of a multimodal volume-editing environment in the field of neuro-planning

In the course of this work, various state-of-the-art techniques in the context of volume visualization,segmentation, and editing will be implemented. The goal is to create an interactive software environment to support surgeons in their planning process.

Requirements:

Mandatory: C++, Shader programming, OpenGL (or DirectX), Volume visualization (Raycasting, Tagged Volumes)
Preferable: 3D scenegraphs, Open Inventor

General Problems:

  • Is the input data good enough (resolution, specifically in microsurgery phase) ?
  • Is segmentation of different anatomical structures necessary ?
  • Physically based deformation necessary ?
  • Anatomical Atlas or Model-based techniques necessary ?

Expected General Features:

  • Fused multimodal volume rendering (MR/CT)
  • Direct Volume Editing
  • Tissue deformation
  • 3D Navigation
  • Undo/Redo

Milestones:

Reading of DICOM data (preparation phase)
- Problem: Complex Format
- Solution: Implement DICOM reader or buy DIMOM reader or use open source DICOM reader

Registation of MR and CT data (also 3D Angio ?)
- Problem: Registation is not the focus of our group
- Solution: Rigid registration (landmark-based?)

Mouting of head for optimal trajection (preparation phase)
- Problem: none
- Solution: Linear 3D transformations with semi-transparent volume rendering

Planning of head skin incision and skin (macro-surgery phase)
- Problem: facial musles and nerves must be preserved
- Solution: 3D Volumen Painting and Direct Volume Editing (see TUM paper)

Planning of skull drill hole (macro-surgery phase)
- Problem: none
- Solution: 3D Volumen Painting and Direct Volume Editing (see TUM paper)

Planning of skull cap removal (macro-surgery phase)
- Problem: none
- Solution: 3D Volumen Painting and Direct Volume Editing (see TUM paper)

Cutting of meninges (macro-surgery phase)
- Problem: Not visible in input data
- Solution: skip this phase or add model-based meninges

Endoscopic navigation inside the brain (micro-surgery phase)
- Problem: Model optics of microscope ?
- Solution: Endoscopic camera, allow free camera movement and rotation inside head

Requirement: Brain cutting and deformation (micro-surgery phase)
- Problem: Physically-based deformation requires complex simulation of tissue elasticity
- Solution: plausible but not physically-based deformation for first version, deformation field or parametric deformation (see virtual incision demo)

Requirement: Tumor cutting (micro-surgery phase)
- Problem: Segmentation of tumor necessary ?
- Solution: 3D Volumen Painting and Direct Volume Editing (see TUM paper)

Optional Requirement: skull cap fitting (macro-surgery phase)
- Problem: Interactive placement of skull cap, collision detection
- Solution: not in first version

Supervisors

 K. Bürger, Prof. Dr. R. Westermann

 

News

Matthias Niessner, our new Professor from Stanford University, offers a number of interesting topics for  master theses.

 

A new PhD/PostDoc position on  Computational Fabrication and 3D Printing is available at the Computer Graphics & Visualization group.

 

A new PhD position is available at the games engineering group.  Check it out here.