comscore
News

Google Assistant beats Siri, Alexa and Cortana in AI IQ test

Although Siri seems to have improved a lot.

  • Published: July 26, 2018 3:08 PM IST
google assistant

Voice assistants have become more popular than ever. Currently, we have an option to choose between the likes of Google Assistant, Siri, Amazon Alexa and Cortana. While all of them have become more advanced than ever, the big question still remains, “Which one performs the best?” Now, a recent report published from Loup Ventures answers that question.

In its report, Loup Ventures states to have tested the four voice assistants with 800 questions, spread across five categories of Local, Commerce, Navigation, Information, and Command. The company further graded the assistants on two metrics, whether the assistant was able to understand the question and was it able to deliver a correct response.

After carrying out the intensive test, the firm’s report claims Google Assistant to be the clear winner. It states that Google Assistant was able to understand 100 percent of the questions and was able to answer close to about 86 percent of them correctly. It also triumphed in four of the five categories, only falling behind Siri in the Command category.

Following that was Siri, which misunderstood about 11 questions, but managed to respond correctly to 79 percent of the questions. Siri was also stated to have improved the most in the last year. The firm claimed Apple’s voice assistant to be a little more helpful and versatile, when it came to controlling phone, smart home speaker, music and other things.

On the other hand, Alexa seems to have beaten Cortana for the third place. Amazon’s assistant was able to correctly answer 61 percent of the questions, while Cortana was only able to answer about 59 percent. The two digital assistants misunderstood 13 and 19 questions respectively. While Alexa was touted to win the Commerce category, the voice assistant fell behind mostly because it more often suggested to buy products from Amazon, rather than giving more information on them.

Loup Ventures claims Google Assistant and Siri to have an advantage in the navigation and local categories mostly because they are deeply integrated into smartphones. Cortana and Alexa however, run as third-party apps on Android and iOS smartphone, which fail to reflect their full capabilities.

Watch: Amazon Echo Spot First Look

That said, Loup Ventures’ report claims all assistants to have improved over their last year’s performance. It states that many of the issues the company faced last year have been erased by improving on natural language processing and inter-device connectivity. Further, the firm expects assistants to adapt new skills which will help build on contextual questioning and improve on performing multiple tasks with one command, like the new Siri Shortcuts.

  • Published Date: July 26, 2018 3:08 PM IST