Chinese smartphone makers are known for interpolating scripts that manipulate the benchmark results by allocating additional resources. Now, some of them have been found to be tampering with those benchmark results as well.
Huawei is the newest in this growing list to admit to using benchmark detection software to boost performance and deliver best possible result. The company admitted to this approach in a conversion with Anandtech at IFA 2018. The Chinese smartphone maker, currently the third-largest smartphone brand globally, said it does use such technique in order to stay relevant to its competitors.
Android smartphone makers have been touting performance as the key benefit on their smartphones. An Antutu score, which was initially seen as a credible benchmark value, has been turned into part of teaser. Every other day, a new smartphone comes along that claims to have the highest score on the benchmark application. In order to reach that value, smartphone makers have resorted to measures like detecting the benchmark and increasing the performance to deliver higher score.
At IFA 2018, Dr. Wang Chenglu, President of Software at Huawei’s Consumer Business Group and two reporters from the tech media discussed the need for a standardized benchmark test. Huawei claims that benchmark tests used on smartphones today move away from real-life usage and do not offer the full experience. It is a well established fact that all smartphone makers collaborate with developers of benchmarking platforms to improve performance. Wang told Anandtech that “others do the same testing, get high scores, and Huawei cannot stay silent.”
Huawei is also promising that benchmark data of its future devices will be verified by third parties. It is not immediately clear what it means by verifying data using third party but it could be a step in right direction considering the growing emphasis on these benchmark scores.
Watch: Huawei P20 Pro Video Review
At IFA 2018 in Berlin, Huawei announced its next flagship processor named Kirin 980 with 5G support and significant improvement in performance. Huawei Mate 20 series will be the first to be based on this chipset and it will debut in London on October 16. It will be interesting to see how that device performs on benchmark platforms like Antutu and Geekbench.