Image Cropper

5/10/2016
Image Cropper Plugin
Platform project: Sarina Thomas
Willkommen
im DKFZ!
Sarina Thomas
DKFZ, Biologische und
Medizinische Informatik
5/10/2016 | Seite 3
Motivation
• Cropping of images
• Extract region or volume of interest from image
• Focus on relevant anatomical structures
• Combine cropped regions as overlays
• Masking vs. Cropping
Whole volume
Cropped volume
Cropping
Masking
Sarina Thomas
DKFZ, Biologische und
Medizinische Informatik
5/10/2016 | Seite 4
Demo: Current Image Cropper
Current Image Cropper Plugin
Problems:
• Missing support for RGB
• Missing support for 4D
• Interaction broken
• Wrong information UI
• Bounding Box vanishes
• no read/write operation
• ‘Set border pixel value’
does not work properly
• Cone shows weird
behavior on interaction
• Display warning
message does not return
if node is deselected
Sarina Thomas
DKFZ, Biologische und
Medizinische Informatik
5/10/2016 | Seite 5
Concepts: Trial and error
Concepts Bounding object
Image
Cropper
• vtkBoundingBoxWidget
• New Module
BoundingShape
Interactor
• GeometryData
Sarina Thomas
DKFZ, Biologische und
Medizinische Informatik
5/10/2016 | Seite 6
Approach
Core
DataType
mitkBaseData
mitkGeometryData
I/O
mitkGeometry
DataReader
mitkGeometry
DataWriter
Sarina Thomas
DKFZ, Biologische und
Medizinische Informatik
5/10/2016 | Seite 7
Approach
Core
DataType
mitkBaseData
mitkGeometryData
I/O
mitkGeometry
DataReader
mitkGeometry
DataWriter
Modules
Visualization
mitkGeometry
DataMapper2D
mitkGeometry
DataMapper3D
Interaction
mitkGeometry
DataInteractor
Image
mitkGeometryData
Cropper
Sarina Thomas
DKFZ, Biologische und
Medizinische Informatik
5/10/2016 | Seite 8
Approach
Core
DataType
mitkBaseData
mitkGeometryData
I/O
mitkGeometry
DataReader
mitkGeometry
DataWriter
Modules
Visualization
mitkGeometry
DataMapper2D
mitkGeometry
DataMapper3D
Interaction
mitkGeometry
DataInteractor
Image
mitkGeometryData
Cropper
Plugins
UI
mitkImageCropper
View
mitkDataStorage
Sarina Thomas
DKFZ, Biologische und
Medizinische Informatik
5/10/2016 | Seite 9
Demo: New Image Cropper
Features:
• Handle interaction
• BoundingBox handling and
•
•
•
•
New Image Cropper Plugin
appearance
Allows images to have 4D
geometry or RGB
Reader / Writer
Pixel-aligned manipulation
Multiple Bounding objects
Sarina Thomas
DKFZ, Biologische und
Medizinische Informatik
5/10/2016 | Seite 10
Future Work
• Rotation / different shapes  Masking vs. Cropping
• Uncommon image types
• Multilabel support
Image Categories
Geometry
Spacing, Extent, IndexToWorldTransform, Origin,
ImageGeometry
Dimension
1D, 2D, 3D, 4D
Image
Region
Index, Size
PixelType
typedef enum { UNKNOWNPIXELTYPE, SCALAR,
RGB, RGBA, OFFSET, VECTOR, POINT,
COVARIANTVECTOR, SYMMETRICSECONDNKTENSOR,
DIFFUSIONTENSOR3D, COMPLEX, FIXEDARRAY,
MATRIX } IOPixelType;
Component
Type
typedef enum { UNKNOWNCOMPONENTTYPE, UCHAR,
CHAR, USHORT, SHORT, UINT, INT, ULONG, LONG,
FLOAT, DOUBLE } IOComponentType;
Overlays
Auf Wiedersehen
im DKFZ!