Development of a multimodal volume-editing environment in the field of neuro-planning
In the course of this work, various state-of-the-art techniques in the context of volume visualization,segmentation, and editing will be implemented. The goal is to create an interactive software environment to support surgeons in their planning process.
Requirements:
Mandatory: C++, Shader programming, OpenGL (or DirectX), Volume visualization (Raycasting, Tagged Volumes)
Preferable: 3D scenegraphs, Open Inventor
General Problems:
- Is the input data good enough (resolution, specifically in microsurgery phase) ?
- Is segmentation of different anatomical structures necessary ?
- Physically based deformation necessary ?
- Anatomical Atlas or Model-based techniques necessary ?
Expected General Features:
- Fused multimodal volume rendering (MR/CT)
- Direct Volume Editing
- Tissue deformation
- 3D Navigation
- Undo/Redo
Milestones:
Reading of DICOM data (preparation phase)
- Problem: Complex Format
- Solution: Implement DICOM reader or buy DIMOM reader or use open source DICOM reader
Registation of MR and CT data (also 3D Angio ?)
- Problem: Registation is not the focus of our group
- Solution: Rigid registration (landmark-based?)
Mouting of head for optimal trajection (preparation phase)
- Problem: none
- Solution: Linear 3D transformations with semi-transparent volume rendering
Planning of head skin incision and skin (macro-surgery phase)
- Problem: facial musles and nerves must be preserved
- Solution: 3D Volumen Painting and Direct Volume Editing (see TUM paper)
Planning of skull drill hole (macro-surgery phase)
- Problem: none
- Solution: 3D Volumen Painting and Direct Volume Editing (see TUM paper)
Planning of skull cap removal (macro-surgery phase)
- Problem: none
- Solution: 3D Volumen Painting and Direct Volume Editing (see TUM paper)
Cutting of meninges (macro-surgery phase)
- Problem: Not visible in input data
- Solution: skip this phase or add model-based meninges
Endoscopic navigation inside the brain (micro-surgery phase)
- Problem: Model optics of microscope ?
- Solution: Endoscopic camera, allow free camera movement and rotation inside head
Requirement: Brain cutting and deformation (micro-surgery phase)
- Problem: Physically-based deformation requires complex simulation of tissue elasticity
- Solution: plausible but not physically-based deformation for first version, deformation field or parametric deformation (see virtual incision demo)
Requirement: Tumor cutting (micro-surgery phase)
- Problem: Segmentation of tumor necessary ?
- Solution: 3D Volumen Painting and Direct Volume Editing (see TUM paper)
Optional Requirement: skull cap fitting (macro-surgery phase)
- Problem: Interactive placement of skull cap, collision detection
- Solution: not in first version
Supervisors
