Workshop on

Egocentric Vision:
From Science to Real-World Applications

Indiana University, Bloomington Indiana — June 3-5, 2017

Sponsored by the Indiana University Ostrom Grants Program, the College of Arts and Science, the School of Informatics and Computing, and the OVPR Emerging Areas of Research program.


Overview

Lightweight, wearable cameras allow collecting vast quantities of video data that approximate the visual field of the camera wearer. Scientists are mounting these devices on people in order to analyze the visual experiences of infants, for example. Egocentric cameras have also been used to study human and animal cognition, human-human social interaction, human-robot interaction, and human expertise in complex tasks. Meanwhile, from a computer science perspective, these devices record huge volumes of imagery that require new automatic techniques for effective browsing, search, and visualization. Initial technical advances have included personalized video summarization, understanding of social saliency, activity analysis, human interaction recognition, and focus of attention modeling. As these techniques become more advanced, we expect wearable cameras to unlock a variety of consumer applications, including helping people suffering from memory loss recall to assisting people with visual impairments.

We believe this is only the tip of the iceberg, and that egocentric cameras and computer vision could transform how scientists conduct their research by collecting and analyzing high-density, high-volume video data. There is a long history of connections and collaborations between human and computer vision; the pioneering early work of Dr. David Marr made immense contributions to both fields, for example. Since then, each field has progressed tremendously and has grown into its own large research area with its own subareas and topics. The emerging area of egocentric vision provides a unique opportunity to strengthen the connection between human and computer vision.

This workshop brings together leading scholars from human and computer vision, to explore opportunities for collaboration and to help plan the future of this emerging area. The specific goals are:

  • to define emerging areas of collaborative research and applications ready for breakthrough advances;
  • to specify key challenges that need to be solved; and
  • to form new collaborative networks to pursue these areas of opportunity.
  • The workshop is supported in part by a grant program in memory of Vincent and Elinor Ostrom, both of whom served on the faculty of IU for many years. Elinor Ostrom was awarded the Nobel prize in economics in 2009. Moreover, this workshop is a kick-off event for a broader $2.5 million investment by IU's Emerging Areas of Research Program into investigating the connections and collaborations between human and machine learning.

     



     

    Workshop Program

    Saturday June 3
    7:00pm Reception
     
    Sunday June 4
    8:15am Breakfast
    8:30am Introductions
    9:00am Invited talks I
     
    11:45am Discussion (Chen Yu)
     
    12:30pm Lunch
     
    2:00pm Invited talks II
    3:30pm Coffee break
    4:00pm Atypical development

    Opportunities and challenges for studies of egocentric vision in ASD
    [video] [slides]
    Dan Kennedy
    4:40pm
     
     
    5:00pm Discussion (Linda Smith)
    5:45pm Posters
    7:15pm Dinner
     
    Monday June 5
    8:00am Breakfast
    8:20am Welcome by Raj Acharya, Dean and Rudy Professor of Engineering, Computer Science, and Informatics
    8:30am Egocentric vision
     
    10:00am Discussion (David Crandall)
    10:30am Coffee break
    11:00am Discussion: Frontiers of egocentric vision
    12:20pm Concluding remarks  

     

    Unless otherwise noted, talks will take place in Room 102 of Multidisciplinary Science Building II (MSB II) on the Indiana University Bloomington campus.

     


    Sponsors and Acknowledgements

    This workshop was made possible by funding from:

  • The Ostrom Workshop at Indiana University
  • IU Office of the Vice Provost for Research, through the Emerging Areas of Research program
  • IU School of Informatics and Computing
  • IU Department of Psychological and Brain Sciences
  •  

    We also gratefully acknowledge:

  • Website design and maintenance: Ramya Rao
  • Video conferencing and recording: Sven Bambach and Ramya Rao
  • Financial support: Erik Stolterman, Raj Acharya
  • Reimbursements: Michele Dompke, Elaine Parsley, John Tweedie
  • Travel logistics: Charlene Tay, Charlotte Wozniak
  • Student volunteers: Tom Dedek, Grace Lisandrelli, Umay Suanda
  • Post-doc volunteers: Drew Abney, Sven Bambach, Grace Lisandrelli, Lauren Sloan, Lei Yuan, Yayun Zhang
  •