Portfolio - Anatoly Churikov

Portfolio
Anatoly Churikov
www.achurikov.com
Email: [email protected]
Linkedin Profile
References available upon request
October, 2014
Anatoly Churikov
www.achurikov.com
An applied researcher with a focus on computer vision, hardware development and industrial design.
Particularly interested in advanced human interface devices, sensors, virtual reality and high-performance
computer vision systems. With a cross disciplinary skill set, including electrical engineering, firmware
development, user experience and mechanical design, which results in the ability to rapidly prototype
hardware concepts. Participates in international groups, events and internships allowing for collaboration
with some of the best minds in the field.
Work experience
Code Laboratories, Inc.
June 2012 - Present
Role: Research Scientist - Computer Vision (in collaboration with Alex Popovich and Christian Moore)
Worked on a small team to develop the DUO3D vision platform and helped bring it to market. Research
and development of high performance tracking algorithms, which have been applied for tracking of hands,
objects and positional tracking of head mounted displays. Extended research into pass-through video with
virtual reality and the application of 3D vision systems.
Microsoft Applied Sciences Group, Microsoft Corporation
22 April 2013 - 12 July 2013, 13 January 2014 - 02 May 2014
Role: Research Intern (under the mentorship of Dr. Cati Boulanger and Tristan Trutna)
Conceptualization, designing and building of novel human interface device prototypes. Tasks included
mechanical engineering, advanced PCB prototyping, firmware, driver and demo applications development.
Delivered results under an extremely tight deadline. Experimented with various of sensors and different
types of haptic actuators. Collaborated with group members and formalized concepts into patent
applications which have been filed.
Microsoft Applied Sciences Group, Microsoft Corporation
29 May 2012 - 17 August 2012
Role: Research Intern (under the mentorship of Dr. Cati Boulanger)
Conceptualized and implemented a novel hardware technique to sense gestures on mobile devices (via
touch-aware skin sensors) for adapting device behaviour in various ways. Designed a hardware enclosure,
motherboard interface pcb, firmware and demo applications development with follow up user experience
research. Applied for patent US20130300668 A1.
Natural User Interfaces Group, a global HCI research community
Jan 2009 - Present
Role: Mentor, Contributor, Researcher, Developer
Lead developer of the latest and upcoming versions of Community Core Vision - an open source/crossplatform solution for computer vision and machine sensing, which is widely used (more than 1,000,000
downloads) as a multi-touch tracker. Community mentor in Google Summer of Code 2011 program.
Developer of hybrid illumination technology (laser light plane + diffused illumination) for making opticalbased multi-touch panels more immune to external infrared light. Issued patent RU95142U1.
Institute of Mathematical Modelling, Baltic Federal University
01 October 2009 - 13 April 2011
Role: Application Developer
Developed an automated task distribution system for cluster systems customized for scientific tasks.
Advanced task distribution model design was proposed to meet specific hardware restrictions
2
Anatoly Churikov
www.achurikov.com
Education
Immanuel Kant Baltic Federal University
30 September 2011 - 30 September 2014
PhD Student of Computer Science and Applied Math department majoring in ”Math models, numerical
methods and software systems”.Has completed all academic requirements for the degree(PhD Candidate)
Immanuel Kant Baltic Federal University
01 September 2006 - 30 May 2011
Mathematician and Programming specialist degree (5 years and practical training, equivalent of Master
of Science) majoring in ”IT and information systems administration”, awarded summa cum laude.
Patents/Publications/Conferences
• ”Making Oculus DK1 a little better” article (August 2014)
Wrote article on the topic of passive marker based positional tracking of Oculus DK1 using the
DUO3D stereo camera platform. Demonstrated high performance (130Hz) and full 360 degrees
positional tracking by adding external markers on the HMD straps on the side and back.
• ”Novel interaction techniques for exploring applied mathematical models of human
physiology”
A. Churikov, V. Kramarenko (25-30 November 2013). Moscow, Russia. MIPT 56th AllRussian Scientific Conference ”Current problems in fundamental and applied sciences in the modern
information society”
We introduce novel multi-touch and contact-free interaction techniques for exploring mathematical
models of human physiology. Methods of enhancing interaction, visualization and discoverability of
human physiology models via immersive virtual and augmented reality systems are proposed
• ”Grip-Based Device Adaptations” patent application US20130300668 A1
Microsoft Corporation (Nov 14 2013)
Grip-based device adaptations are described in which a touch-aware skin of a device is employed to
adapt device behavior in various ways. The touch-aware skin may include a plurality of sensors from
which a device may obtain input and decode the input to determine grip characteristics indicative of
a user’s grip. On-screen keyboards and other input elements may then be configured and located in
a user interface according to a determined grip. In at least some embodiments, a gesture defined to
facilitate selective launch of on-screen input element may be recognized and used in conjunction with
grip characteristics to launch the on-screen input element in dependence upon grip. Additionally,
touch and gesture recognition parameters may be adjusted according to a determined grip to reduce
misrecognition
• ”Realtime adaptive binarization of low contrast images” publication
Immanuel Kant Baltic Federal University (October 2010)
A proposed method for low contrast image binarization by utilizing adaptive binarization and the
implementation of the proposed method with the GPGPU computing paradigm
• ”Hybrid multitouch display technology” issued patent RU95142U1
Immanuel Kant Baltic Federal University (October 2010)
A hybrid approach for lighting (Laser Light Plane and Diffused Illumination) touch surface is
proposed in this patent, which allows increase stability of optical-based multitouch displays.
3
Anatoly Churikov
www.achurikov.com
Volunteer experience
Google Summer of Code 2011 program mentor, Natural User Interfaces Group
May 2011 - September 2011
Mentor in Google Summer of Code 2011 program from NUI Group. Mentored project ”Multiple
Camera Support” and participated as an advisor in another GSoC 2011 project - ”CCV GPU CUDA
Tracking”.
Instructor, Microsoft Innovation Center at Baltic Federal University
October 2009 - July 2011
Arranging entry and intermediate level lectures in .NET (C#), WPF, Surface SDK and HCI.
Microsoft Student Partner, Baltic Federal University
2008 - 2011
Participated in a worldwide educational program to sponsor students majoring in disciplines related to
technology. Shared knowledge among the academic community by arranging courses, giving presentations
and lectures, and initiating projects among students.
Honors and Awards
•
Russian National Science and Engineering Competition ”IT Breakthrough
2010”, December 2010
Organizing Committee of National competition (Microsoft, Softline, Autodesk)
Winner in ”Hardware” category. Project - thin 42 inch LCD based multitouch table, which uses
multiple (9 in the prototype) cameras for tracking objects on the touch surfaces.
•
State science contest ”Eureka 2010”, May 2010
Organizing Committee from Kaliningrad State Government
Winner in Technology category. Project - thin 42 inch LCD based multitouch table, which uses
multiple (9 in the prototype) cameras for tracking objects on the touch surfaces.
•
Microsoft Imagine Cup 2009 Russian Final, April 2009
Microsoft and Intel
Special prize by Intel Corporation for the ”Most Innovative Project” and ”Audience Award”.
Project - A pair of interactive gloves that allow to use multitouch gestures in the air.
•
Dev Generation 2009, May 2009
Softline Venture Partners Softline
Second place. Project - A pair of interactive gloves that allow the use multi-touch gestures in the air.
•
•
•
•
Russian ”Presidential Scholarship” for undergraduate students (2010-2011)
Scholarship award by federal scholarship programme of V. Potanin’s fund (2008-2010)
”Governor’s scholarship” for academic achievements (2009-2011)
Five-year ”Honor Scholarship” for academic achievements (2006-2011)
4
Anatoly Churikov
www.achurikov.com
Projects
DUO3D stereo camera (June 2012 - Present)
Role: Research Scientist - Computer Vision, Industrial Design
DUO3D is an ultra-compact imaging sensor with a standard USB interface. Intended for use in research,
industrial and integration, the camera’s high speed and small size make it ideal for existing and new use
cases for stereo vision based applications.With a programmable illumination board and built-in IR filters
it allows for precise control of lighting environment.
Project evolution from PS3 Eye based DIY kit (on the left) to production version (right)
Responsible for research and development of high-precision low-latency pattern-based object trackers and
other related computer vision problems built on the DUO3D stereo camera. Experimenting with stereobased depth reconstruction algorithms and virtual reality by adding vision to head mounted displays,
robust positional tracking and research into pass through vision systems.
5
Anatoly Churikov
www.achurikov.com
Oculus DK1 positional tracking via DUO3D camera
DUO3D emits IR light with it’s embedded LEDs and captures reflected light back from retro-reflective
markers placed on the Oculus DK1. Then tracking software finds correlation between IMU data captured
from Oculus DK1, with markers trajectories for separating ”good markers” (on HMD) from ”false-positive”
(from environment). Advanced filtering techniques are then applied afterwards for noise-free detection and
HMD tracking. System works at more than 130Hz and provides 360◦ positional tracking.
Retroreflective markers on Oculus DK1 (including straps) and DUO3D camera clipped to a monitor
Robust hand tracking with DUO3D camera
Advanced hand tracking algorithm works at more than 140Hz with high accuracy. Allows finger tracking
even in case of light self occlusion, which is demonstrated in the demo video.
Single (left) and multiple fingers (right) robust tracking via DUO3D camera
6
Anatoly Churikov
www.achurikov.com
Community Core Vision 1.5
Role: Project Coordinator, Lead Developer
The main goal with this release was to offer stable multi-camera support, enhance code quality and
performance. The project was supported by Google under the Google Summer of Code program. This
version contains many long awaited updated in both features and the codebase:
•
•
•
•
•
•
•
•
•
Automatic Camera Detection
New Camera Layout Editor with Drag/Drop GUI and Device list
Per Camera - Calibration, Preview mode and Settings Dialogs
Interleave Mode for Stitching/Blending
Optimized Fiducial Tracking
Migrated to TUIO 1.1 version for blob support
Fully threaded Capture and Stitching
Allows different cameras types to be used simultaneously
Updated cameras supported (CMU, DirectShow, Firefly, Kinect and PS3 Eye)
At this moment CCV has over 1,000,000 logged downloads
CCV 1.5 interface mode (left) and drag’n’drop calibration mode(right)
7
Anatoly Churikov
www.achurikov.com
Thin 42 inch LCD based multi-touch table
Role: Project Manager, Lead Developer, Industrial Designer
In order to reduce the table depth, 9 infrared cameras were used for fingers and objects tracking on
the surface. A hybrid approach for lighting (Laser Light Plane and Diffused Illumination) was
implemented in this hardware setup to track fiducials. Cameras, LEDs and lasers were synchronized to
reduce sensitivity to external ambient infrared light.
Top images - table design, left bottom - raw image of hands on stitched image, right bottom - raw image
of brush
8