comscore Emotion could transform the way we experience artificial intelligence
News

Emotion could transform the way we experience artificial intelligence

This startup wants to beat Amazon and Google to add emotional layer to digital assistants but the road ahead is not easy.

emotion-ai-entropik-tech-main

Source: Entropik Tech


Voice is doing to human-machine interface what touch did years ago. The primary driver behind voice winning over touch is digital assistants. These have become parts of our digital lives. Amazon Alexa, Google Assistant and Apple Siri help you access information via your phone, smart speakers, laptops and other devices. Also Read - Amazon Glow is an interactive projector, video calling device for your kids

Also Read - Amazon Glow, Echo Show 15, Astro robot, more launched: Everything announced

I spend a few minutes talking to Alexa everyday. My interaction ranges from requests to play music, have news updates read out to me and tracking sports. Alexa always answers those questions with poise and when she doesn’t know something, her reply “Sorry, I didn’t understand the question” strikes as one from a robot butler. Is Alexa or Google Assistant useful? Well the answer is yes. With home automation, you can walk into your house and say Alexa, turn on lights or you can make her lock the door. There is endless scenario where they can be useful but one area, where they need work is understanding human emotion. Also Read - 5 best AR or VR toys to help your child learn while having fun: Orboot Mars, Educational flashcards and more

Every time you talk to Alexa or Google Assistant or Bixby or Siri or Cortana, they understand the context but not the semantics of it. For instance, whether you softly ask or yell at these digital assistants, they will only know that you have requested music. They are not capable of understanding the emotion behind that sound. If these digital assistants hope to replace our current set of devices powered by touch mainly then they need to understand emotion.

Emotion, as defined by Wikipedia, is “any conscious experience characterized by intense mental activity and a certain degree of pleasure or displeasure.” One key reason why smart assistants cannot understand the mental activity or tone of your request is because they lack the conscious experience. But it is set to change very soon. “AI – whether consumer-centric or business-centric – need to emotionally aware in the next five years,” said Ranjan Kumar, Founder & CEO, Entropik Tech, a company working on Emotion AI.

Amazon and Google are both working on adding an emotion layer to their digital assistants. At I/O 2018 early this year, Google showed a duplex conversation carried out by its digital assistant where the machine interface was able to produce human emotions like “mmhmmm” in the conversation. This is the first step towards making these assistants as human-like as possible. The lack of emotional quotient with digital assistants predominently used right now has also led to rise of smaller companies like Entropik Tech, who are essentially filling the gap.

How is EmotionAI different from traditional AI?

“Any sort of Artificial Intelligence is meant to provide intelligent transaction between human and machine,” explains Ranjan. “What it does not have today is emotional aspect of transaction between human and machine. For instance, the AI today cannot understand whether you are saying something happily or angrily. Can AI be adaptive to those human emotions, that’s what EmotionAI is all about,” he adds.

A very simplistic example of this can be seen in a conversation between a user and a digital assistant. An user might be asking something angrily to Alexa, Amazon’s digital assistant but the reality is that Alexa is not able to understand that context itself. Ranjan says Alexa or Google Assistant are not capable of understanding emotional context in their current form and his company aims to add that layer of emotional activity and are calling it as EmotionAI.

How can Emotion be added to current form of AI?

Emotion is an integral element to humans and it can be detected via facial expression, voice synthesis and neural response. Ranjan tells BGR India that his company uses these traditional elements via brain wave mapping, facial recognition, eye tracking and voice-based emotional tracking to send the emotional context to AI interface.

Before deploying the test data on AIs used by consumers, Entropik Tech is using its EmotionAI in other areas such as retail and product development. “Our voice-based emotional tracking is used to analyse calls and understand whether the customer was happy or disappointed with the experience,” Ranjan explains. He adds that the emotional tracking feature is also used to understand consumer response for Accenture in the retail space, Vodafone Spain in the telecom space and Xiaomi in developing truly consumer-centric devices.

How facial recognition and brain wave mapping are used to build emotional layer?

For brain wave mapping, Entropik Tech uses a special hardware, which works similar to wearing a headphone. The hardware helps track how neurons of the person wearing it fire at second level. The corresponding data can be mapped to attention level of the user and can also judge the mental effort applied towards a context. “The hardware provides us with raw data and we have built the software part to convert these raw data into meaningful information,” Ranjan confirms.

The facial recognition system developed by the team at Entropik can track 58 actionable facial codes from a face. This translated into data ranging from the way you grin, the way you roll your eyes to way you smirk. All of these data can be fed to the machine learning algorithm and deep neural networks those power the modern AI system to become emotionally aware.

What about privacy?

There is no denying the fact that AI cannot improve if we don’t feed it with data. The best example is the Portrait Mode effect on Google’s newest flagship smartphones, the Pixel 3 and Pixel 3 XL. Instead of using dual camera sensors like its rivals, Google is using a single sensor and filling the gap by understanding the depth of an image and deep neural network.

When asked about his emotionAI affecting privacy, Ranjan says there is “technology to ensure that privacy is not affected.” He says data collection and machine learning should happen on the device and not on a cloud service and companies should develop less intrusive ways to track emotion on devices like smartphones. He adds that brain wave mapping will be limited to certain test environments since it requires additional hardware.

“With EmotionAI, the interaction between AI assistant and a human could be as good as one between two humans, contextually aware as well as emotionally aware,” says Ranjan Kumar. The big question for the industry would be lay down ethics for such implementation. The progress of AI could be good for the human society but it should not come at a cost of data privacy and malpractice.

For the latest tech news across the world, latest PC and Mobile games, tips & tricks, top-notch gadget reviews of most exciting releases follow BGR India’s Facebook, Twitter, subscribe our YouTube Channel. Also follow us on  Facebook Messenger for latest updates.
  • Published Date: December 3, 2018 11:00 AM IST



new arrivals in india

Realme 8i
Realme 8i

13,999

Realme 8s 5G
Realme 8s 5G

17,999

Xiaomi Redmi 10 Prime
Xiaomi Redmi 10 Prime

12,499

Samsung Galaxy A52s 5G
Samsung Galaxy A52s 5G

35,999

Samsung Galaxy M32 5G
Samsung Galaxy M32 5G

20,999

Vivo Y33s
Vivo Y33s

17,990

Realme C21Y
Realme C21Y

8,999

Vivo Y21
Vivo Y21

15,490

Realme GT Master Edition
Realme GT Master Edition

25,999

Realme GT 5G
Realme GT 5G

37,999

Itel A48
Itel A48

6,399

Motorola Edge 20
Motorola Edge 20

29,999

Motorola Edge 20 Fusion
Motorola Edge 20 Fusion

21,499

Samsung Galaxy Z Flip 3
Samsung Galaxy Z Flip 3

84,999

Samsung Galaxy Z Fold 3
Samsung Galaxy Z Fold 3

1,49,999

Samsung Galaxy A12 (Exynos)
Samsung Galaxy A12 (Exynos)

13,999

Nokia C20 Plus
Nokia C20 Plus

8,999

Vivo Y53s
Vivo Y53s

19,490

Tecno Pova 2
Tecno Pova 2

10,999

Infinix Smart 5A
Infinix Smart 5A

6,499

Micromax In 2b
Micromax In 2b

8,999

Vivo Y72 5G
Vivo Y72 5G

20,990

Tecno Camon 17
Tecno Camon 17

12,999

Tecno Camon 17 Pro
Tecno Camon 17 Pro

16,999

Realme C11 2021
Realme C11 2021

6,999

Oppo Reno6 Pro 5G
Oppo Reno6 Pro 5G

39,990

Oppo Reno6 5G
Oppo Reno6 5G

29,990

Samsung Galaxy M21 2021
Samsung Galaxy M21 2021

12,499

OnePlus Nord 2
OnePlus Nord 2

27,999

Poco F3 GT
Poco F3 GT

27,999

Samsung Galaxy A22 5G
Samsung Galaxy A22 5G

19,999

Xiaomi Redmi Note 10T 5G
Xiaomi Redmi Note 10T 5G

13,999

Samsung Galaxy F22
Samsung Galaxy F22

12,499

Xiaomi Mi 11 Lite
Xiaomi Mi 11 Lite

21,999

Infinix Note 10 Pro
Infinix Note 10 Pro

16,999

Infinix Note 10
Infinix Note 10

10,999

Vivo Y73
Vivo Y73

20,990

OnePlus Nord CE 5G
OnePlus Nord CE 5G

22,999

iQOO Z3
iQOO Z3

19,990

Realme C25s
Realme C25s

9,999

Poco M3 Pro 5G
Poco M3 Pro 5G

13,999

Realme X7 Max 5G
Realme X7 Max 5G

26,999

Oppo F19
Oppo F19

18,990

Motorola Moto G40 Fusion
Motorola Moto G40 Fusion

13,999

POCO M2 Reloaded
POCO M2 Reloaded

9,499

OPPO A74 5G
OPPO A74 5G

17,990

Oppo A53s 5G
Oppo A53s 5G

14,990

Vivo V21 5G
Vivo V21 5G

29,990

Realme C25
Realme C25

9,499

Realme C21
Realme C21

7,999

Realme C20
Realme C20

6,799

Motorola Moto G60
Motorola Moto G60

17,999

iQOO 7
iQOO 7

31,990

Samsung Galaxy M42 5G
Samsung Galaxy M42 5G

21,999

Xiaomi Mi 11 Ultra
Xiaomi Mi 11 Ultra

69,999

Xiaomi Mi 11X Pro 5G
Xiaomi Mi 11X Pro 5G

39,999

Xiaomi Mi 11X
Xiaomi Mi 11X

29,999

Realme 8 5G
Realme 8 5G

13,999

Samsung Galaxy F02s
Samsung Galaxy F02s

8,999

Samsung Galaxy F12
Samsung Galaxy F12

10,999

POCO X3 Pro
POCO X3 Pro

18,999

Realme 8 Pro
Realme 8 Pro

17,999

Realme 8
Realme 8

14,999

Vivo X60 Pro Plus
Vivo X60 Pro Plus

69,990

Vivo X60 Pro
Vivo X60 Pro

49,990

Vivo X60
Vivo X60

37,990

OnePlus 9 Pro 5G
OnePlus 9 Pro 5G

64,999

OnePlus 9R 5G
OnePlus 9R 5G

39,999

OnePlus 9 5G
OnePlus 9 5G

49,999

Samsung Galaxy A72
Samsung Galaxy A72

34,999

Samsung Galaxy A52
Samsung Galaxy A52

26,499

Micromax In 1
Micromax In 1

10,499

Asus ROG Phone 5
Asus ROG Phone 5

49,999

Samsung Galaxy M12
Samsung Galaxy M12

10,999

Motorola Moto G30
Motorola Moto G30

10,999

Motorola Moto G10 Power
Motorola Moto G10 Power

9,999

Oppo F19 Pro Plus 5G
Oppo F19 Pro Plus 5G

25,990

Oppo F19 Pro
Oppo F19 Pro

21,490

Xiaomi Redmi Note 10 Pro Max
Xiaomi Redmi Note 10 Pro Max

18,999

Xiaomi Redmi Note 10 Pro
Xiaomi Redmi Note 10 Pro

15,999

Xiaomi Redmi Note 10
Xiaomi Redmi Note 10

11,999

Realme Narzo 30A
Realme Narzo 30A

8,999

Realme Narzo 30 Pro
Realme Narzo 30 Pro

16,999

Infinix Smart 5
Infinix Smart 5

7,199

Samsung Galaxy F62
Samsung Galaxy F62

23,999

Samsung Galaxy A12
Samsung Galaxy A12

12,999

Nokia 5.4
Nokia 5.4

13,999

Nokia 3.4
Nokia 3.4

11,999

Realme X7 Pro 5G
Realme X7 Pro 5G

29,999

Realme X7
Realme X7

19,999

Vivo Y31
Vivo Y31

16,490

Oppo Reno5 Pro 5G
Oppo Reno5 Pro 5G

35,990

Samsung Galaxy S21 Ultra 5G
Samsung Galaxy S21 Ultra 5G

1,05,999

Samsung Galaxy S21 Plus 5G
Samsung Galaxy S21 Plus 5G

81,999

Samsung Galaxy S21 5G
Samsung Galaxy S21 5G

69,999

Vivo Y12s
Vivo Y12s

9,990

Vivo Y51A
Vivo Y51A

17,990

Samsung Galaxy M02s
Samsung Galaxy M02s

8,999

Xiaomi Mi 10i
Xiaomi Mi 10i

21,999

Oppo A15s
Oppo A15s

11,490

Best Sellers