Scientists are developing new technologies that will allow computers to recognize non-verbal commands such as gestures, body language and facial expressions. For most people, using a computer is limited to clicking, typing, searching, and, thanks to Siri and similar software, verbal commands. Also Read - Arvind Krishna will take over as CEO of IBM, James Whitehurst to be President
“Compare that with how humans interact with each other, face to face — smiling, frowning, pointing, tone of voice all lend richness to communication,” researchers said. The new project titled “Communication Through Gestures, Expression and Shared Perception,” aims to revolutionize everyday interactions between humans and computers. Also Read - Lenovo Legion C730 Cube and Y25f-10 Monitor Review: Convenient and impressive
“Current human-computer interfaces are still severely limited,” said Professor Bruce Draper, from Colorado State University (CSU), who is leading the project. Also Read - Xiaomi could introduce a new Mi Notebook on November 6
“First, they provide essentially one-way communication: users tell the computer what to do. This was fine when computers were crude tools, but more and more, computers are becoming our partners and assistants in complex tasks. Communication with computers needs to become a two-way dialogue,” said Draper.
The team has proposed creating a library of what are called Elementary Composable Ideas (ECIs). Like little packets of information recognizable to computers, each ECI contains information about a gesture or facial expression, derived from human users, as well as a syntactical element that constrains how the information can be read.
To achieve this, the researchers have set up a Microsoft Kinect interface. A human subject sits down at a table with blocks, pictures and other stimuli. The researchers try to communicate with and record the person’s natural gestures for concepts like “stop,” or, “huh?”