Phone shopping? Beware benchmark cheats!

[thangfish]

Looks like all the "bigs" (except Apple and Motorola) are cheating on benchmarks, by detecting them and playing with cpu cores, frequency and thermal limits.

AnandTech | They're (Almost) All Dirty: The State of Cheating in Android Benchmarks

 

[chanchan05]

That's only something if you pay attention to benchmarks. It shows the full capability of the CPU but they don't really factor really into real life usage even if they don't cheat.

EDIT: This is actually one of the reasons I prefer to look at their performances on Epic Citadel as opposed to benchmark tests. At least some reviewers use that. It's not a benchmark test per se as it is a game.

https://play.google.com/store/apps/details?id=com.epicgames.EpicCitadel&hl=en

 

[kate]

The hilarious part of all of this is we’re still talking about small gains in performance. The impact on our CPU tests is 0 - 5%

I was expecting the difference to be 20% or more from cheating.

But when looking at phones I'm more concerned with the features it has, not if it's 5% faster.

 

[chanchan05]

I was expecting the difference to be 20% or more from cheating.

But when looking at phones I'm more concerned with the features it has, not if it's 5% faster.

Still inside the negligible zone when talking about CPU performance in everyday use IMO. LOL.