Computational Methods for Integrating Vision and Language

Kobus Barnard is a professor of computer science at the University of Arizona. He also has appointments in the School of Information: Science, Technology, and Arts (SISTA), Statistics, Cognitive Science, Electrical and Computer Engineering (ECE), and the BIO5 Institute. He leads the Interdisciplinary Visual Intelligence Laboratory (IVILAB.org). Professor Barnard received his Ph.D. in computer science in 2000 from Simon Fraser University (SFU) in the area of computational color constancy, where his dissertation received the Governor General gold medal awarded across all disciplines. He then spent two years at the University of California at Berkeley as a postdoctoral researcher working on modeling the joint statistics of images and associated text, followed by moving to the University of Arizona. His current research addresses problems in interdisciplinary computational intelligence by developing top-down statistical models that are predictive, semantic, and explanatory. Application domains include computer vision, multimedia data, biological structure and processes, astronomy, and human social interaction. His work has been funded by multiple grants from NSF including a CAREER award, DARPA, ONR, ARBC (Arizona Biomedical Commission), and the University of Arizona BIO5 Institute.

• Acknowledgments.- Figure Credits.- Introduction.- The Semantics of Images and Associated Text.- Sources of Data for Linking Visual and Linguistic Information.- Extracting and Representing Visual Information.- Text and Speech Processing.- Modeling Images and Keywords.- Beyond Simple Nouns.- Sequential Structure.- Bibliography.- Author's Biography.