Curriculum vitae - University of North Carolina at Chapel Hill

Vicente Ord´
on
˜ ez-Rom´
an
(publishes as Vicente Ordonez)
Contact
Information
257 Sitterson Hall
Department of Computer Science
Chapel Hill, NC 27599-3175 USA
[email protected]
Phone: (631) 413 7794
http://www.cs.unc.edu/∼vicente
Research
Interests
My interests lie in the intersection of large scale computational visual recognition, natural
language understanding, digital media and big data analysis.
Education
University of North Carolina at Chapel Hill (UNC)
2013 - 2015
PhD Candidate in Computer Science
Thesis: Language and Perceptual Categorization in Computational Visual Recognition
Committee: Tamara L. Berg (advisor), Alexander C. Berg, Jan-Michael Frahm
Yejin Choi (University of Washington), Alexei A. Efros (UC Berkeley)
Stony Brook University, The State University of New York (SUNY)
PhD Candidate in Computer Science (Transferred with advisor)
Master of Science in Computer Science (GPA: 3.98/4.0)
2009 - 2013
Escuela Superior Politecnica del Litoral (ESPOL), Ecuador.
Computer Engineering degree (GPA: 9.22/10.0)
2003 - 2008
Selected
Awards
Research Highlight of the Communications of the ACM, 2014
IEEE Marr Prize in Computer Vision, 2013
Yahoo! Key Scientific Challenges Award, 2012
Renaissance Technologies Fellowship, 2009 - 2011.
Philantropic Society Medal, Guayaquil, Guayas, Ecuador, 2007.
Equality and Excellence Scholarship. Escuela Superior Politecnica del Litoral, 2005 - 2007.
Highest GPA in the Computer Engineering Program, 2004 - 2007.
Industry
Experience
Microsoft Research, Cambridge, Massachusetts.
Research Intern in the Computer Vision Group
Large scale computer vision and scene understanding.
Working with Ce Liu and Michael Rubinstein.
Summer 2014
eBay Research Labs, San Jose, California.
Research Intern
Worked on attribute predictions on catalog image and text
collections in the Mantis Computer Vision group.
Work presented at WACV’14 and filed a US Patent.
Summer 2013
Google, Mountain View, California.
Summer 2011
Software Engineering Intern
Automatic organization of personal image collections with the Android.
Multimedia Content Analysis group and Google Research.
This work evolved into the Google+ Beautiful Movies made Auto Awesomely.
Google, Mountain View, California.
Spring 2008, Summer 2008
Software Engineering Intern
Developed code for automated quality analysis of satellite images
at the imagery database group for Google Earth and Google Maps.
1 of 6
Academic
Experience
Publications
University of North Carolina at Chapel Hill
Research Assistant at the Computer Science Department
Visual language grounding and extracting visual meaning
from large scale noisy collections of text and images.
2013 - Present
Stony Brook University, Stony Brook, New York.
Research Assistant at the Vision and Digital Media Lab
Large scale analysis of text and images, large scale image classification,
language generation and eye gaze data analysis.
2010 - 2013
Center for Information Technologies (ESPOL), Guayaquil, Ecuador.
Research Assistant at the Technology Enhanced Learning Group
Worked on e-learning and document retrieval under Prof. Xavier Ochoa
and collaboration with Prof. Erik Duval (KU Leuven)
2006 - 2009
Predicting Entry-Level Categories.
Vicente Ordonez, Wei Liu, Jia Deng, Yejin Choi, Alexander C. Berg, Tamara L. Berg.
International Journal of Computer Vision - Marr Prize Special Issue. IJCV.
(In submission)
ReferitGame: Referring to Objects in Photographs of Natural Scenes.
Sahar Kazemzadeh*, Vicente Ordonez*, Mark Matten, Tamara L. Berg
Empirical Methods on Natural Language Processing. EMNLP 2014. Doha, Qatar.
(Oral presentation)
Learning High-level Judgments of Urban Perception.
Vicente Ordonez, Tamara L. Berg
European Conference on Computer Vision. ECCV 2014. Zurich, Switzerland.
Large Scale Retrieval and Generation of Image Descriptions.
V. Ordonez, X. Han, P. Kuznetsova, G. Kulkarni, M. Mitchell, K. Yamaguchi, K. Stratos, A.
Goyal, J. Dodge, A. Mensch, H. Daume III, A.C. Berg, Y. Choi, T.L. Berg.
International Journal of Computer Vision IJCV (Accepted for publication)
(Journal Paper)
TreeTalk: Composition and Compression of Trees for Image Descriptions.
Polina Kuznetsova, Vicente Ordonez, Tamara L. Berg, Yejin Choi.
Transactions of the Association of Computational Linguistics. TACL 2014
Presented at EMNLP 2014. Doha, Qatar. (Oral presentation)
(Journal Paper)
FurnitureGeek: Understanding Fine-Grained Furniture Attributes from Freely
Associated Text and Tags. Vicente Ordonez, Vignesh Jagadeesh, Wei Di, Anurag Bhardwaj, Robinson Piramuthu. IEEE Winter Conference on Applications of Computer Vision.
WACV 2014. Steamboat Springs, CO
From Large Scale Image Categorization to Entry Level Categories.
Vicente Ordonez, Jia Deng, Yejin Choi, Alexander C. Berg, Tamara L. Berg.
IEEE International Conference on Computer Vision. ICCV 2013. Sidney, Australia.
(Oral presentation) (Best Paper Award - Marr Prize)
(Selected for publication in the Research Highlights of the Communications of the ACM Magazine)
2 of 6
Generalizing Image Captions for Image-Text Parallel Corpus.
Polina Kuznetsova, Vicente Ordonez, Alexander C. Berg, Tamara L. Berg, Yejin Choi.
Association for Computational Linguistics. ACL 2013. short. Sofia, Bulgaria.
Babytalk: Understanding and Generating Image Descriptions.
G. Kulkarni, V. Premraj, V. Ordonez, S. Dhar, S. Li, Y. Choi, A. C. Berg, T. L. Berg.
IEEE Transactions on Pattern Analysis and Machine Intelligence. PAMI 2013.
(Journal paper)
Collective Generation of Natural Image Descriptions.
Polina Kuznetsova, Vicente Ordonez, Alexander C. Berg, Tamara L. Berg, Yejin Choi.
Association for Computational Linguistics. ACL 2012. Jeju, South Korea.
(Oral presentation)
Im2Text: Describing Images Using 1 Million Captioned Photographs.
Vicente Ordonez, Girish Kulkarni, Tamara L. Berg.
Neural Information Processing Systems. NIPS 2011. Granada, Spain.
(Spotlight presentation)
High Level Describable Attributes for Predicting Aesthetics and Interestingness.
Sagnik Dhar, Vicente Ordonez, Tamara L. Berg.
IEEE Computer Vision and Pattern Recognition. CVPR 2011. Colorado Springs, CO.
The Ariadne Infrastructure for Managing and Storing Metadata.
S. Ternier, G. Parra, B. Vandeputte, K. Verbert, J. Klerkx, E. Duval, V. Ordonez, X. Ochoa.
Emerging Internet Technologies and Applications for E-learning.
IEEE Internet Computing 2009.
(Journal paper)
Patents
Techniques for Automatic Photo Album Generation. Google Inc.
Vicente Ordonez, Wei Hua, Rodrigo L. Carceroni, Jennifer Gillenwater, Amarnag Subramanya. US Patent Application No. 13/628,735
Technical
Presentations
Language and Perceptual Categorization in Computer Vision (Invited Talk ) February 2015
Carnegie Mellon University, The Robotics Institute VASC Seminar Series
Hosted by Prof. Abhinav Gupta.
Language and Perceptual Categorization in Computer Vision (Invited Talk )
Disney Research Pittsburgh, The Walt Disney Company.
Hosted by Senior Research Scientist Leonid Sigal.
January 2015
Language and Perceptual Categorization in Computer Vision (Invited Talk ) December 2014
Stanford University, Department of Computer Science, Vision Group.
Hosted by Prof. Fei-fei Li.
ReferitGame: Referring to Objects in Photographs of Natural Scenes (Talk )
Empirical Methods in Natural Language Processing EMNLP 2014
Marriott Marquis City Center, Doha, Qatar
3 of 6
October 2014
Learning High-level Judgments of Urban Perception (Invited talk )
September 2014
ECCV 2014 Workshop on Storytelling with Images and Videos
ECCV 2014 Workshop on Human-Machine Communication for Visual Recognition
ETH Zurich, Switzerland.
Learning Connections between Language and Vision from Large Data (Talk )
Mid-Atlantic Computer Vision Workshop. MACV 2014
Virginia Tech, Blacksburg, Virginia.
April 2014
From Large Scale Image Categorization to Entry Level Categories (Talk )
IEEE International Conference on Computer Vision
Sydney Conference Centre Darling Harbour, Australia.
Dec 2013
Understanding Image Descriptions in the Wild (Invited Talk )
Yahoo! Labs, Sunnyvale, California, USA
Hosted by Research Scientist Amit Goyal.
July 2013
Data-driven Generation of Image Descriptions (Invited Talk )
June 2013
North American Chapter of the Association for Computational Linguistics (NAACL)
Workshop on Vision and Language (WVL) 2013. Atlanta, GA
Generating Image Descriptions using Large Scale Vision (Poster )
Vicente Ordonez, Tamara L. Berg.
The Second Multimedia and Vision Meeting in Greater New York Area.
Organizers: Columbia University and IBM T.J. Watson Research Center.
June 2012
Im2Text: Describing Images Using 1 Million Captioned Photographs (Spotlight)
Vicente Ordonez, Girish Kulkarni, Tamara L. Berg.
Annual Conference on Advances in Neural Information Processing Systems
Granada Congress and Exhibition Centre. Granada, Spain
Dec. 2011
Technical
Skills
Programming Languages: Most experienced in C/C++, Java, Python and Matlab.
Other skills: Web Development, Android Development, OpenCV, OpenGL.
Teaching
Experience
Computer Vision. University of North Carolina - Chapel Hill
Guest Lecture for Prof. Jan-Michael Frahm
Topic: Big Data for Generating Image Descriptions
Artificial Intelligence. University of North Carolina - Chapel Hill
Guest Lecture for Prof. Tamara L. Berg
Topic: Big Data for Generating Image Descriptions
Advanced Multimedia. Stony Brook University
Guest Lecture for Prof. Tamara L. Berg
Topic: Stereo Reconstruction and Kinect
Computational Photography. Stony Brook University
Guest Lecture for Prof. Tamara L. Berg
Topic: Big Data for Generating Image Descriptions
Foundations of Computer Science. Stony Brook University
Teaching Assistant for Prof. Leo Bachmair
Duties: Recitations classes and grading
4 of 6
November 2014
January 2014
April 2013
March 2013
Fall 2009, Spring 2010
Object Oriented Programming. ESPOL, Guayaquil, Ecuador
Teaching Assistant for 4 courses
Duties: Recitation classes and grading
2005-I, 2005-II
Programming Fundamentals. ESPOL, Guayaquil, Ecuador
Teaching Assistant for 2 courses
Duties: Recitation classes and grading
Physics for Engineering Students. ESPOL, Guayaquil, Ecuador
Teaching Assistant for 2 courses
Duties: Recitation classes, crafting homework and grading
Other
Activities
2004-I
Summer 2004
Program Commitee.
ECCV 1st Workshop on Storytelling with Images and Videos - VisStory 2014
ECCV Workshop on Human-Machine Communication for Visual Recognition and Search 2014
Stony Brook University Computer Science Graduate Research Conference GRC 2010
Reviewer.
Computer Vision and Pattern Recognition (CVPR) 2015
Association for Computational Linguistics (ACL) 2014
International Journal in Computer Vision (IJCV) 2014
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2014, 2015
Elsevier Computer Vision and Image Understanding (CVIU) 2014, 2015
Elsevier Information Processing Letters (IPL) 2014
IEEE Transactions on Neural Networks and Learning Systems (TNNLS) 2014
IEEE Transactions on Multimedia (TM) 2013.
IEEE Transactions on Image Processing (TIP) 2013.
ACM Multimedia (MM) 2010. International Multimedia Conference.
Graduate Students Organization Senator.
Stony Brook University. 2010 - 2011
References
from faculty
References
from Industry
Prof. Tamara L. Berg
Assistant Professor
Department of Computer Science
UNC Chapel Hill
[email protected]
(919) 590-6018
Prof. Alexander C. Berg
Assistant Professor
Department of Computer Science
UNC Chapel Hill
[email protected]
(919) 590-6022
Prof. David Forsyth
Professor
Department of Computer Science
University of Illinois at Urbana-Champaign
[email protected]
(217) 265-6851
Prof. Yejin Choi
Assistant Professor
Natural Language Processing Lab
University of Washington, Seattle
[email protected]
(607) 280-4546
Dr. Rodrigo L. Carceroni
Staff Software Engineer / Manager
Multimedia Content Analysis Team
Google, Mountain View, CA
[email protected]
Dr. Ce Liu
Senior Research Scientist / Research Affiliate
Google Research / MIT CSAIL
Cambridge, MA
[email protected]
5 of 6
References
from
Collaborators
Dr. Polina Kuznetsova
PhD Student / Research Scientist
Natural Language Processing Group
Stony Brook University / Facebook
[email protected]
Collaborations: ACL’12, ACL’13, TACL’14
Prof. Jia Deng
Postdoctoral Researcher / Assistant Professor
Department of Computer Science
Stanford University / University of Michigan
[email protected]
Collaborations: ICCV’13, IJCV’14
6 of 6