MAR Reference Model

MAR Reference Model
CD Document Structure, September 2014
Online version of the MAR RM available here:
http://wg11.sc29.org/augmentedReality/
MAR Reference Model
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
SCOPE
DOCUMENT STRUCTURE
SYMBOLS AND ABBREVIATED TERMS
MAR DOMAIN AND CONCEPTS
MAR REFERENCE MODEL USAGE EXAMPLE
MAR TERMINOLOGY
MAR REFERENCE SYSTEM ARCHITECTURE
MAR CLASSIFICATION FRAMEWORK
MAR SYSTEM CLASSES
PERFORMANCE
SAFETY
SECURITY
PRIVACY
USE CASE EXAMPLES AND COVERAGE BY MAR REFERENCE MODEL
EXISTENT MAR RELATED SOLUTION/TECHNOLOGIES AND THEIR
COVERAGE OF MAR-RM
ANNEX A (INFORMATIVE) PATENT STATEMENTS
MAR Reference Model
4
MAR DOMAIN AND CONCEPTS
!
!
The MAR concept as combining
representations of physical objects and
computer mediated virtual ones in various
modalities.
The Mixed Reality Continuum
MAR Reference Model
5
MAR REFERENCE MODEL USAGE EXAMPLE
Designing a MAR application or service
Deriving a MAR business model
Extend existing or create new standards for MAR
MAR Reference Model
6
MAR TERMINOLOGY
MAR Reference Model
7
MAR REFERENCE SYSTEM ARCHITECTURE
!
!
!
Enterprise, Computational and Informational Viewpoint
MAR Reference Model
8
MAR CLASSIFICATION FRAMEWORK
Component
Dimension
Types
Pure Sensors
Modality
Visual
Auditory
Source type
Live
Pre-captured
Real World
capturer
Recognizer
Tracker
Space Mapper
Event Mapper
Simulator
Renderer
Visual Display
Electro-magnetic waves (e.g. GPS)
Haptic/Tactile
3D mesh
Other
Auditory
Stil image
Source type
Live
Form of Target Signal
Form of the Output Event
Pre-captured
Image patch
3D primitives
3D Model
Location (e.g. earth- reference coordinates)
patch
Other
Recognized or not Additional data: Type, Timestamp, Recognition confidence level, other attributes
Execution place Local
Form of Target Signal
Remote
Image patch
Form of the Output Event
Spatial (2D, 3D, 6D, …)
3D primitives
Haptics
Aural
3D Model
Earth- reference coordinates
Aural (Intensity, Pitch, …)
Others
Location
Others
Hybrid
Multi-user
Haptics
Hybrid
Projection
Controlled
3D holographic
Other
Aural Display
Haptics Display
UI
Other physical properties
Modality
Visual
Form of Visual Modality
Execution place Local
Remote
Space type
Spatial
Audio
Modality
Visual
Temporal
Space & time
2D + t
3D + t
User Interactivity Yes
No
Execution place Local
Remote
Number of
simultaneous users
Single-user
Modality
Visual
Aural
Execution place Local
Remote
Presentation
Optical see through Video see through
Mobility
Fixed
Mobile
No of channels
2D (mono)
3D stereoscopic
Haptics properties Other
2D Video
3D Video (video + depth)
Temperature
No of channels
Mono
Acoustic space coverage
Type
Vibration
Interaction type
Touch
Spatial
Headphones
Pressure
Click
Speaker
Temperature
Drag
Gesture
Other
Audio patch
Haptic (Force, Direction, …)
Audio
Other
MAR Reference Model
9
MAR SYSTEM CLASSES
MAR Class V
MAR Class R
augmenting the 2D visual data captured by real or virtual camera
augmenting the 2D visual data continuously captured by one or several
real cameras and reconstructing the 3D environment (note: SLAM, PTAM)
MAR Class A
MAR Class H
MAR Class G
augmenting the aural modality
augmenting the haptics modality
using global position system to register synthetic objects in the real world
MAR Class 3DV
augmenting the 3D visual data captured by multiple cameras or video
plus depth cameras
augmenting the scene by using 3D audio data
MAR Class 3DA
MAR Reference Model
14
USE CASE EXAMPLES AND COVERAGE BY MAR REFERENCE MODEL
!
!
!
MAR Reference Model
15
EXISTENT MAR RELATED SOLUTION/TECHNOLOGIES AND THEIR
COVERAGE OF MAR-RM
KML/ARML/KARML
X3D
Junaio
OpenCV / OpenVX
!
ARAF
Vuforia
Layar
ARToolKit/OSGART