View projects by: General topic         Technical approach         Year

Social media mining

A unified model for near and remote sensing
Scott Workman, Menghua Zhai, David Crandall, Nathan Jacobs
ICCV 2017
A deep study into the history of web design
Bardia Doosti, David Crandall, Norman Makoto Su
WEBSCI 2017
Tracking Natural Events through Social Media and Computer Vision
Jingya Wang, Mohammed Korayem, Saul Blanco, David Crandall
ACMMM 2016
Where have all the people gone? Enhancing global conservation using night lights and social media
Noam Levin, Salit Kark, David Crandall
Ecological Applications 2015
Linking past to present: Discovering style in two centuries of architecture
Stefan Lee, Nicolas Maisonneuve, David Crandall, Alexei Efros, Josef Sivic
ICCP 2015
Multimodal Learning in Loosely-organized Web Images
Kun Duan, David Crandall, Dhruv Batra
CVPR 2014
SfM with MRFs: Discrete-Continuous Optimization for Large-Scale Structure from Motion
David Crandall, Andrew Owens, Noah Snavely, Daniel Huttenlocher
PAMI 2013
Observing the natural world with Flickr
Jingya Wang, Mohammed Korayem, David Crandall
ICCV CVCP Workshop 2013
Best paper award!
Modeling people and places with internet photo collections
David Crandall, Noah Snavely
CACM 2012
Mining Photo-sharing Websites to Study Ecological Phenomena
Haipeng Zhang, Mohammed Korayem, David Crandall, Gretchen LeBuhn
WWW 2012
Networks of Landmarks, Photos, and People
David Crandall, Noah Snavely
Leonardo 2011
Discrete-Continuous Optimization for Large-scale Structure from Motion
David Crandall, Andrew Owens, Noah Snavely, Daniel Huttenlocher
CVPR 2011
Best paper runner-up!
Mapping the World's Photos
David Crandall, Lars Backstrom, Daniel Huttenlocher, Jon Kleinberg
WWW 2009
Best paper honorable mention!

Egocentric computer vision

DoTA: Unsupervised Detection of Traffic Anomaly in Driving Videos
Yu Yao, Xizi Wang, Mingze Xu, Zelin Pu, Yuchen Wang, Ella Atkins, David Crandall
PAMI 2023
Situated Cameras, Situated Knowledges: Towards an Egocentric Epistemology for Computer Vision
Sam Goree, David Crandall
IEEE CVPR Joint International Third Ego4D and Eleventh EPIC Workshop 2023
Stepwise Goal-Driven Networks for Trajectory Prediction
Chuhua Wang, Yuchen Wang, Mingze Xu, David Crandall
RAL 2022
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, Miguel Martin, Tushar Nagarajan, Ilija Radosavovic, Santhosh Kumar Ramakrishnan, Fiona Ryan, Jayant Sharma, Michael Wray, Mengmeng Xu, Eric Zhongcong Xu, Chen Zhao, Siddhant Bansal, Dhruv Batra, Vincent Cartillier, Sean Crane, Tien Do, Morrie Doulaty, Akshay Erapalli, Christoph Feichtenhofer, Adriano Fragomeni, Qichen Fu, Christian Fuegen, Abrham Gebreselasie, Cristina Gonzalez, James Hillis, Xuhua Huang, Yifei Huang, Wenqi Jia, Weslie Khoo, Jachym Kolar, Satwik Kottur, Anurag Kumar, Federico Landini, Chao Li, Yanghao Li, Zhenqiang Li, Karttikeya Mangalam, Raghava Modhugu, Jonathan Munro, Tullie Murrell, Takumi Nishiyasu, Will Price, Paola Ruiz Puentes, Merey Ramazanova, Leda Sari, Kiran Somasundaram, Audrey Southerland, Yusuke Sugano, Ruijie Tao, Minh Vo, Yuchen Wang, Xindi Wu, Takuma Yagi, Yunyi Zhu, Pablo Arbelaez, David Crandall, Dima Damen, Giovanni Maria Farinella, Bernard Ghanem, Vamsi Krishna Ithapu, Jawahar, Hanbyul Joo, Kris Kitani, Haizhou Li, Richard Newcombe, Aude Oliva, Hyun Soo Park, James Rehg, Yoichi Sato, Jianbo Shi, Mike Zheng Shou, Antonio Torralba, Lorenzo Torresani, Mingfei Yan, Jitendra Malik
CVPR 2022
Can Gaze Inform Egocentric Action Recognition?
Zehua Zhang, David Crandall, Michael Proulx, Sachin Talathi, Abhishek Sharma
ETRA 2022
Whose hand is this? Person Identification from Egocentric Hand Gestures
Satoshi Tsutsui, Yanwei Fu, David Crandall
WACV 2021
Localizing novel attended objects in egocentric views
Shujon Naha, Md Alimoor Reza, Chen Yu, David Crandall
BMVC 2020
HOPE-Net: A Graph-based Model for Hand-Object Pose Estimation
Bardia Doosti, Shujon Naha, Majid Mirbagheri, David Crandall
CVPR 2020
Interaction Graph for Object Importance Estimation in On-road Driving Videos
Zehua Zhang, Ashish Tawari, Sujitha Martin, David Crandall
ICRA 2020
Egocentric Vision-based Future Vehicle Localization for Intelligent Driving Assistance Systems
Yu Yao, Mingze Xu, Chiho Choi, David Crandall, Ella Atkins, Behzad Dariush
ICRA 2019
Unsupervised Traffic Accident Detection in First-Person Videos
Yu Yao, Mingze Xu, Yuchen Wang, David Crandall, Ella Atkins
IROS 2019
Temporal Recurrent Networks for Online Action Detection
Mingze Xu, Mingfei Gao, Yi-Ting Chen, Larry Davis, David Crandall
ICCV 2019
Embodied Visual Recognition: Learning to Move for Amodal Perception
Jianwei Yang, Zhile Ren, Mingze Xu, Xinlei Chen, David Crandall, Devi Parikh, Dhruv Batria
ICCV 2019
A Self Validation Network for Object-Level Human Attention Estimation
Zehua Zhang, Chen Yu, David Crandall
NeurIPS 2019
Estimating Head Motion from Egocentric Vision
Satoshi Tsutsui, Sven Bambach, David Crandall, Chen Yu
ICMI 2018
Joint Person Segmentation and Identification in Synchronized First- and Third-person Videos
Mingze Xu, Chenyou Fan, Yuchen Wang, Michael Ryoo, David Crandall
ECCV 2018
Deepdiary: Lifelogging image captioning and summarization
Chenyou Fan, Zehua Zhang, David Crandall
JVCI 2018
Identifying first-person camera wearers in third-person videos
Chenyou Fan, Jangwon Lee, Mingze Xu, Krishna Kumar Singh, Yong Jae Lee, David Crandall, Michael Ryoo
CVPR 2017
Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions
Sven Bambach, Stefan Lee, David Crandall, Chen Yu
ICCV 2015
This Hand is My Hand: A Probabilistic Approach to Hand Disambiguation in Egocentric Video
Stefan Lee, Sven Bambach, David Crandall, John Franchak, Chen Yu
CVPR Egovision Workshop 2014
Best paper award!

Object recognition

Graph Neural Network and Spatiotemporal Transformer Attention for 3D Video Object Detection from Point Clouds
Junbo Yin, Jianbing Shen, Xin Gao, David Crandall, Ruigang Yang
PAMI 2023
VindLU: A recipe for Effective Video-and-Language Pretraining
Feng Cheng, Xizi Wang, Jie Lei, David Crandall, Mohit Bansal, Gedas Bertasius
CVPR 2023
Action Recognition based on Cross-Situational Action-object Statistics
Satoshi Tsutsui, Xizi Wang, Guangyuan Weng, Yayun Zhang, David Crandall, Chen Yu
ICDL 2022
Part Segmentation of Unseen Objects Using Keypoint Guidance
Shujon Naha, Qingyang Xiao, Prianka Banik, Md Alimoor Reza, David Crandall
WACV 2021
Learning Video Object Segmentation from Unlabeled Videos
Xiankai Lu, Wenguan Wang, Jianbing Shen, Yu-Wing Tai, David Crandall, Steven Hoi
CVPR 2020
Zero-Shot Video Object Segmentation via Attentive Graph Neural Networks
Wenguan Wang, Xiankai Lu, Jianbing Shen, David Crandall, Ling Shao
ICCV 2019
Meta-Reinforced Synthetic Data for One-Shot Fine-Grained Visual Recognition
Satoshi Tsutsui, Yanwei Fu, David Crandall
NeurIPS 2019
Toddler-Inspired Visual Object Learning
Sven Bambach, David Crandall, Linda Smith, Chen Yu
NeurIPS 2018
Recognizing landmarks in large-scale social image collections
David Crandall, Yunpeng Li, Stefan Lee, Daniel Huttenlocher
Visual Analysis and Geolocalization of Large Scale Imagery 2016
Human pose estimation through composite multi-layer models
Kun Duan, Dhruv Batra, David Crandall
Signal Processing 2015
Vehicle Recognition with Constrained Multiple Instance SVMs
Kun Duan, Luca Marchesotti, David Crandall
WACV 2014
Discovering Localized Attributes for Fine-grained Recognition
Kun Duan, Devi Parikh, David Crandall, Kristen Grauman
CVPR 2012
Composite Models of Objects and Scenes for Category Recognition
David Crandall, Daniel Huttenlocher
CVPR 2007
thumbnail
Color Object Detection using Spatial-Color Joint Probability Functions
Jiebo Luo, David Crandall
IEEE Trans. Image Processing 2006

Extraction of special effects caption text events from digital video
David Crandall, Sameer Antani, Rangachar Kasturi
IJDAR 2002
Robust Extraction of Text in Video
Sameer Antani, David Crandall, Rangachar Kasturi
ICPR 2000

Privacy and security

Semantically Stealthy Adversarial Attacks against Segmentation Models
Zhenhua Chen, Chuhua Wang, David Crandall
WACV 2022
thumbnail
Plasmonic Anti-counterfeit Tags with High Encoding Capacity Rapidly Authenticated with Deep Machine Learning
Joshua Smith, Md Alimoor Reza, Nathanael Smith, Jianxin Gu, Maha Ibrar, David Crandall, Sara Skrabalak
ACS Nano 2021

Deep Neural Network-based Detection and Verification of Microelectronic Images
Md Alimoor Reza, Zhenhua Chen, David Crandall
Journal of Hardware and Systems Security 2020
Automatically Detecting Bystanders in Photos to Reduce Privacy Risks
Rakibul Hasan, David Crandall, Mario Fritz, Apu Kapadia
OAKLAND 2020
Addressing supply chain risks of microelectronic devices through computer vision
Zhenhua Chen, Tingyi Wanyan, Ramya Rao, Benjamin Cutilli, James Sowinski, David Crandall, Robert Templeman
AIPR 2017
Cartooning for enhanced privacy in lifelogging and streaming video
Eman Hassan, Rakibul Hasan, Patrick Shaffer, David Crandall, Apu Kapadia
CVPR CV-COPS 2017 2017
Enhancing Lifelogging Privacy by Detecting Screens
Mohammed Korayem, Robert Templeman, Dennis Chen, David Crandall, Apu Kapadia
CHI 2016
Honorable Mention Award!
PlaceAvoider: Steering First-Person Cameras away from Sensitive Spaces
Robert Templeman, Mohammed Korayem, David Crandall, Apu Kapadia
NDSS 2014
Reactive Security: Responding to Visual Stimuli from Wearable Cameras
Robert Templeman, Roberto Hoyle, David Crandall, Apu Kapadia
Ubicomp UPSIDE Workshop 2014
PlaceRaider: Virtual Theft in Physical Spaces with Smartphones
Robert Templeman, Zahidur Rahman, David Crandall, Apu Kapadia
NDSS 2013

Human visual learning

Are you with me? Modeling joint attention from egocentric vision
Ryan Peters, Andrei Amatuni, Sara Schroer, Shujon Naha, David Crandall, Chen Yu
COGSCI 2021
In-the-Moment Visual Information Determines Learning
Andrei Amatuni, Sara Schroer, Ryan Peters, Md Alimoor Reza, Yayun Zhang, David Crandall, Chen Yu
COGSCI 2021
Learning the generative principles of a symbol system from limited examples
Lei Yuan, Violet Xiang, David Crandall, Linda Smith
Cognition 2020
A Computational Model of Early Word Learning from the Infant's Point of View
Satoshi Tsutsui, Arjun Chandrasekaran, Md Alimoor Reza, David Crandall, Chen Yu
COGSCI 2020
How do infants start learning object names in a sea of clutter?
Hadar Karmazyn Raz, Drew Abney, David Crandall, Chen Yu, Linda Smith
COGSCI 2019
An Egocentric Perspective on Active Vision and Visual Object Learning in Toddlers
Sven Bambach, David Crandall, Linda Smith, Chen Yu
ICDL 2017
Exploring inter-observer differences in first-person object views using deep learning models
Sven Bambach, Zehua Zhang, David Crandall, Chen Yu
ICCV MBCC 2017 2017
Objects in the Center: How the Infant's Body Constrains Infant Scenes
Sven Bambach, Linda Smith, David Crandall, Chen Yu
ICDL 2016
Best paper award!
Active Viewing in Toddlers Facilitates Visual Object Learning: An Egocentric Vision Approach
Sven Bambach, David Crandall, Linda Smith, Chen Yu
COGSCI 2016
Understanding Embodied Visual Attention in Child-Parent Interaction
Sven Bambach, David Crandall, Chen Yu
ICDL 2013

Wearable camera attitudes and opportunities

Privacy Norms and Preferences for Photos Posted Online
Roberto Hoyle, Luke Stark, Qatrunnada Ismail, David Crandall, Apu Kapadia, Denise Anthony
TOCHI 2020
Can Privacy Be Satisfying? On Improving Viewer Satisfaction for Privacy-Enhanced Photos Using Aesthetic Transforms
Rakibul Hasan, Yifang Li, Eman Hassan, Kelly Caine, David Crandall, Roberto Hoyle, Apu Kapadia
CHI 2019
Viewer Experience of Obscuring Scene Elements in Photos to Enhance Privacy
Rakibul Hasan, Eman Hassan, Yifang Li, Kelly Caine, David Crandall, Roberto Hoyle, Apu Kapadia
CHI 2018
Addressing Physical Safety, Security, and Privacy for People with Visual Impairments
Tousif Ahmed, Patrick Shaffer, Kay Connelly, David Crandall, Apu Kapadia
SOUPS 2016
Sensitive Lifelogs: A Privacy Analysis of Photos from Wearable Cameras
Roberto Hoyle, Robert Templeman, Denise Anthony, David Crandall, Apu Kapadia
CHI 2015
Privacy Concerns and Behaviors of People with Visual Impairments
Tousif Ahmed, Roberto Hoyle, Kay Connelly, David Crandall, Apu Kapadia
CHI 2015
Privacy Behaviors of Lifeloggers using Wearable Cameras
Roberto Hoyle, Robert Templeman, Steven Armes, Denise Anthony, David Crandall, Apu Kapadia
UBICOMP 2014

Machine learning

Examining the Impact of Network Architecture on Extracted Feature Quality for CBR
Zachary Wilkerson, Vibhas Vats, Karan Acharya, David Leake, David Crandall
ICCBR 2023
Case Adaptation with Neural Networks: Capabilities and Limitations
Xiaomeng Ye, David Leake, David Crandall
ICCBR 2022
Extracting Case Indices from Convolutional Neural Networks: A Comparative Study
David Leake, Zachary Wilkerson, David Crandall
ICCBR 2022
Generating Counterfactual Images: Toward a C2C-VAE Approach
Ziwei Zhao, David Leake, Xiaomeng Ye, David Crandall
ICCBR Workshop on CBR for Explanation of Intelligent Systems 2022
Controlling the Quality of Distillation in Response-Based Network Compression
Vibhas Vats, David Crandall
AAAI International Workshop on Practical Deep Learning in the Wild 2022
Learning Adaptations for Case-Based Classification: A Neural Network Approach
Xiaomeng Ye, David Leake, Vahid Jalali, David Crandall
ICCBR 2021
On Combining Knowledge-Engineered and Network-Extracted Features for Retrieval
Zachary Wilkerson, David Leake, David Crandall
ICCBR 2021
Applying the Case Difference Heuristic to Learn Adaptations from Deep Network Features
Xiaomeng Ye, Ziwei Zhao, David Leake, Xizi Wang, David Crandall
IJCAI Workshop on Deep Learning, Case-Based Reasoning, and AutoML: Present and Future Synergies 2021
Bringing Case Based Reasoning to Deep Learning
David Leake, David Crandall
International Conference on Case-Based Reasoning Special Track on Challenges and Promises 2020
Generalized Capsule Networks with Trainable Routing Procedure
Zhenhua Chen, Chuhua Wang, Tiancong Zhao, David Crandall
International Conference on Machine Learning Workshop on Generalization 2019
Diverse Beam Search for Improved Description of Complex Scenes
Ashwin Vijayakumar, Michael Cogswell, Ramprasaath Selvaraju, Qing Sun, Stefan Lee, David Crandall, Dhruv Batra
AAAI 2018
Stochastic Multiple Choice Learning for Training Diverse Deep Ensembles
Stefan Lee, Senthil Purushwalkam, Michael Cogswell, Viresh Ranjan, David Crandall, Dhruv Batra
NeurIPS 2016
Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models
Ashwin K Vijayakumar, Michael Cogswell, Ramprasath Selvaraju, Qing Sun, Stefan Lee, David Crandall, Dhruv Batra
2016

Computer vision for glaciology[More details on these projects]

Deep Tiered Image Segmentation for Detecting Internal Ice Layers in Radar Imagery
Yuchen Wang, Mingze Xu, John Paden, Lara Koenig, Geoffrey Fox, David Crandall
ICME 2021
Automated Ice-Bottom Tracking of 2D and 3D Ice Radar Imagery Using Viterbi and TRW-S
Victor Berger, Mingze Xu, Mohanad Al-Ibadi, Shane Chu, David Crandall, John Paden, Geoffrey Fox
JSTARS 2019
Multi-Task Spatiotemporal Neural Networks for Structured Surface Reconstruction
Mingze Xu, Chenyou Fan, John Paden, Geoffrey Fox, David Crandall
WACV 2018
Crossover Analysis and Automated Layer-Tracking Assessment of the Extracted DEM of the Basal Topography of the Canadian Arctic Archipelago Ice-Cap
Mohanad Al-Ibadi, Jordan Sprick, Sravya Athinarapu, Victor Berger, Theresa Stumpf, John Paden, Carl Leuschen, Fernando Rodriguez, Mingze Xu, David Crandall, Geoffrey Fox, David Burgess, Martin Sharp, Luke Copland, Wesley Van Wychen
IEEE Radar Conference 2018
Automatic estimation of ice bottom surfaces from radar imagery
Mingze Xu, David Crandall, Geoffrey Fox, John Paden
ICIP 2017
Automatic Near Surface Estimation from Snow Radar Imagery
Jerome Mitchell, David Crandall, Geoffrey Fox, John Paden
IGARSS 2013
Layer-finding in radar echograms using probabilistic graphical models
David Crandall, Geoffrey Fox, John Paden
ICPR 2012

Modeling social networks

De-anonymizing users across heterogeneous social computing platforms
Mohammed Korayem, David Crandall
ICWSM 2013
Chelsea Won, and You Bought a T-shirt: Characterizing the Interplay Between Twitter and E-Commerce
Haipeng Zhang, Nish Parikh, Gyanit Singh, Neel Sundaresan
ASONAM 2013
Best paper award!
Inferring Social Ties from Geographic Coincidences
David Crandall, Lars Backstrom, Daniel Cosley, Siddharth Suri, Daniel Huttenlocher, Jon Kleinberg
PNAS 2010
Feedback Effects between Similarity and Social Influence in Online Communities
David Crandall, Daniel Cosley, Daniel Huttenlocher, Jon Kleinberg, Sid Suri
KDD 2008

Other projects

Finding Its Voice: Exploring the Influence of Robot Voices on Fit, Social Attributes, and Willingness Among Older Adults in the U.S. and Japan
Long-Jing Hsu, Weslie Khoo, Natasha Randall, Waki Kamino, Swapna Joshi, Hiroki Sato, David Crandall, Kate Tsui, Selma Sabanovic
ROMAN 2023
Spill the Tea: When Robot Conversation Agents Support Well-being for Older Adults
Weslie Khoo, Long-Jing Hsu, Kyrie Jig Amon, Pranav Vijay Chakilam, Wei-Chu Chen, Zachary Kaufman, Agness Lungu, Hiroki Sato, Erin Seliger, Manasi Swaminathan, Katherine Tsui, David Crandall, Selma Sabanovic
Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction 2023
The Affective Growth of Computer Vision
Norman Su, David Crandall
CVPR 2021
Investigating the Homogenization of Web Design: A Mixed-Methods Approach
Sam Goree, Bardia Doosti, David Crandall, Norman Su
CHI 2021
Computer Vision for Dietary Assessment
Chia-Fang Chung, Alejandra Ramos, Pei-Ni Chiang, Chien-Chun Wu, Connie Anne Tan, Weslie Khoo, David Crandall
CHI Workshop on Realizing AI in Healthcare: Challenges Appearing in the Wild 2021
Automatic dense annotation for monocular 3d scene understanding
Md Alimoor Reza, Kai Chen, Akshay Naik, David Crandall, Soon-Heung Jung
IEEE Access 2020
Studying Empirical Color Harmony in Design
Sam Goree, David Crandall
IEEE Conference on Computer Vision and Pattern Recognition Workshop on Computer Vision for Fashion, Art, and Design 2020
Towards Detecting Dyslexia in Children's Handwriting Using Neural Networks
Katie Spoon, David Crandall, Katie Siek
ICML Workshop on AI for Social Good 2019
Hello Research! Developing an Intensive Research Experience for Undergraduate Women
Suzanne Menzel, Katie Siek, David Crandall
SIGCSE 2019
Observing Pianist Accuracy and Form with Computer Vision
Jangwon Lee, Bardia Doosti, Yupeng Gu, David Cartledge, David Crandall, Christopher Raphael
WACV 2019
Automatic Annotation for Semantic Segmentation in Indoor Scenes
Md Alimoor Reza, Akshay Naik, Kai Chen, David Crandall
IROS 2019
Minimizing Supervision for Free-space Segmentation
Satoshi Tsutsui, Tommi Kerola, Shunta Saito, David Crandall
CVPR Workshop on Autonomous Driving 2018
mFingerprint: Privacy-preserving user modeling with multimodal mobile device footprints
Haipeng Zhang, Zhixian Yan, Jun Yang, Emmanuel Munguia Tapia, David Crandall
SBP 2014
From funding agencies to scientific agency: Collective allocation of science funding as an alternative to peer review
Johan Bollen, David Crandall, Damion Junk, Ying Ding, Katy Borner
EMBO Reports 2014
Solving Avatar Captchas automatically
Mohammed Korayem, Abdallah Mohamed, David Crandall, Roman Yampolskiy
AMLTA 2012
Subjectivity and Sentiment Analysis of Arabic: A Survey
Mohammed Korayem, David Crandall, Muhammad Abdul-Mageed
AMLTA 2012

The IU Computer Vision Lab's projects and activities have been funded, in part, by grants and contracts from the Air Force Office of Scientific Research (AFOSR), the Defense Threat Reduction Agency (DTRA), Dzyne Technologies, EgoVid, Inc., ETRI, Facebook, Google, Grant Thornton LLP, IARPA, the Indiana Innovation Institute (IN3), the IU Data to Insight Center, the IU Office of the Vice Provost for Research through an Emerging Areas of Research grant, the IU Social Sciences Research Commons, the Lilly Endowment, NASA, National Science Foundation (IIS-1253549, CNS-1834899, CNS-1408730, BCS-1842817, CNS-1744748, IIS-1257141, IIS-1852294), NVidia, ObjectVideo, Office of Naval Research (ONR), Pixm, Inc., and the U.S. Navy. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of the U.S. Government, or any sponsor.