Professor Frank Keller, Professor of Computational Cognitive Science in the School of Informatics, delivers his inaugural lecture entitled, “How Humans (and Machines) Integrate Language and Vision”.
When humans process text or speech, this often happens in a visual context, e.g., when listening to a lecture, reading a map, or describing an image. Using an eye-tracker, human gaze can be accurately recorded during such tasks, and in this lecture I will show how eye-tracking data can be combined with computational modeling to understand how human cognition integrates linguistic and visual information. I will also touch upon applications such as computer-aided translation and automatic image annotation.
Recorded on Tuesday 30 September 2014 at the University of Edinburgh’s Informatics Forum.