22 October 2018
Smartphone manufacturers refer to the benchmark results when they have to tell how their devices exhibit in different scenarios. Well, performance is something which can’t be told on paper. So, the manufacturers have to rely on some tests to tell the buyers about the worth of their devices. But, numbers don’t really matter to every buyer or a tech enthusiast would only know what actually goes behind those benchmarks.
There are several companies that cheated the benchmark results with an aim to grab the buyers’ attention but luckily, their deeds got uncovered immediately.
Now, reportedly Huawei and Honor have been found tempering their benchmark results. AnandTech discovered that Huawei has been caught optimizing some of its top smartphones to over-perform on benchmark tests. It has been found that Huawei P20 has been programmed to maximize the performance specifically when running 3DMark. The benchmarking app’s company then followed up with a statement stating that P20 will be delisted as well three other Huawei phones from its leaderboards.
In a conversation at IFA 2018 in Berlin with Anandtech, Huawei indirectly confirmed that the manufacturer had to do it in order to stay relevant to its competitors.
Dr. Wang Chenglu, President of Software at Huawei’s Consumer Business Group and two reporters from the fellow tech media discussed the need for standardized benchmarks.
Wang said, “others do the same testing, get high scores, and Huawei cannot stay silent.”
Huawei, however, has promised to the tech reporters that in future, benchmark data will be verified by third parties. This is clear that while Huawei hasn’t stated this directly, but it is admitting to doing what they are doing, citing specific vendors in China.
Later, Huawei provided statement to Android Authority,
Huawei always prioritizes the user experience rather than pursuing high benchmark scores – especially since there isn’t a direct connection between smartphone benchmarks and user experiences. Huawei smartphones use advanced technologies such as AI to optimize the performance of hardware, including the CPU, GPU and NPU.
When someone launches a photography app or plays a graphically-intensive game, Huawei’s intelligent software creates a smooth and stable user experience by applying the full capabilities of the hardware, while simultaneously managing the device’s temperature and power efficiency. For applications that aren’t as power intensive like browsing the web, it will only allocate the resources necessary to deliver the performance that’s needed.
In normal benchmarking scenarios, once Huawei’s software recognizes a benchmarking application, it intelligently adapts to “Performance Mode” and delivers optimum performance. Huawei is planning to provide users with access to “Performance Mode” so they can use the maximum power of their device when they need to.
Huawei – as the industry leader – is willing to work with partners to find the best benchmarking standards that can accurately evaluate the user experience.