Our ground-breaking artificial intelligence research is developing robots that can learn human language and interact socially with pioneering applications across global industry.
Professor Oliver Lemon's team are developing technology to enable robots and computers to interact naturally with humans, using combinations of speech, gesture, movements and facial expressions. Their leading artificial intelligence (AI) research can make such human-level communication skills a reality, for future systems that will cooperate intelligently.
The Interaction Lab is one of the few places in the world that has pioneered the use of machine learning methods to develop conversational language interfaces. This means that machines can now learn how to have dialogues with people and better understand and generate natural human language. Ultimately, this research will develop new interfaces and robots which are easier, quicker, and more enjoyable to use.
As robots and the 'internet of things' become more integrated into our everyday lives, we will need increasingly complex human interaction systems, to avoid information overload and enjoy more effective and entertaining interaction with new technologies.
The Interaction Lab is breaking new ground in the development of robots that can learn from human language, and how to interact socially with humans; a successful European Commission Horizon 2020 funding call in 2015 resulted in Pepper, Heriot-Watt's resident robot. Pepper exhibits behaviour that is socially appropriate, combining speech-based interaction with non-verbal communication and human-aware navigation.
The team has worked with companies including Yahoo, Orange, and BMW to solve new problems in conversational interaction with machines. Now Professor Lemon and Professor Verena Rieser are leading the PhD team, 'What's Up Bot', who have made it to the final three, in the world, in the $2.5 Million Amazon Alexa Prize.