3D Video Visualization for Event Summarization Yueming Yang1 Ming-Ching Chang2 Siwei Lyu1 Peter Tu2 1SUNY Albany 2GE Global Research Poster 14 Experimental Sites and Results Motivation • Big video data in surveillance camera networks • Video analytics offering: detection, tracking, event recognition • Need for comprehensive video event visualization capabilities GE Global Research – Courtyard • Group behavior recognition Proposed System • • • • 3D event visualization for video summarization Recognition at a glance First-person immersive replay of events (avatar view) User interface for navigation/interaction with 3D video replay GE Global Research – Smart Room • Social interaction analysis Related Works Augmented Virtual Environment [IWVS 2003] 3D Surveillance [CVPRW 2006] HouseFly [MM '10, MIT] Method • 3D Model Reconstruction Using Structure from Motion (SfM) • Site survey, preprocessing • Key point detection, feature extraction • RANSAC feature matching • Sparse recon using Bundle Adjustment • Dense correspondence by stereo matching • Geometric modeling and texture mapping Police Live Surveillance Site (Schenectady, NY) Military Training Facility (Fort Benning, GA) work in progress work in progress Activity tracking heat map GE Courtyard Software Library & Tools GE Courtyard – synthetic top view • Virtual to World Coordinate System Transform Landmark point mapping: Translation: Rotation: solved by SVD Scaling: RANSAC robust estimation • • • • • Bundler [Noah Snavely, 2006] Visual SfM http://ccwu.me/vsfm/ [Changchang Wu, 2011] MeshLab http://meshlab.sourceforge.net/ ActiveMQ message passing http://activemq.apache.org/ VTK http://vtk.org/ This project was jointly supported by (1) grants #2013-IJ-CX-K010 awarded by the National Institute of Justice, US Department of Justice, and (2) the SUNY Albany’s Faculty Research Award Program (2012-2014).
© Copyright 2024 ExpyDoc
