A new Sony Xperia smartphone going by the model number D2403 has surfaced by way of some benchmarks. By looking at the specs in the benchmarks, it seems this unannounced … Continue reading
Major benchmarking service delists Samsung and HTC phones it suspects of cheating
Posted in: Today's ChiliOh yes, things are really starting to kick off in the arcane world of smartphone benchmarking. First, there came clear evidence of phone makers manipulating scores in apps like AnTuTu and GFXBench, and now a more mainstream benchmarking company, Futuremark, has publicly delisted specific Samsung and HTC phones that it suspects of cheating. Futuremark says that the devices in question — including the Galaxy Note 3, HTC One and HTC One Mini — fail to adhere to the fairness policy, which requires that a device treats its 3DMark app just as it would treat any other app, with no tailor-made bursts of performance designed to achieve artificially high scores. Clearly, this bad behavior is just as endemic as we originally feared, so benchmark apps either need to toughen up, as Futuremark appears to be doing, or they need to find entirely new ways of measuring performance.
Filed under: Cellphones, Mobile, Samsung, HTC
Via: HotHardware, The Register
Source: Futuremark
Remember the allegation that Samsung cheats at benchmarks? Despite the manufacturer’s semi-denials, there’s growing evidence to suggest that not only Samsung, but also a number of other Android phone makers engage in some level of chicanery. Usually, it involves programming a device to temporarily ramp up its performance if it detects the launch of a benchmark test, regardless of the consequences for battery life or processor temperature. This results in a higher score on the artificial test, but one that is unrepresentative of what the device could actually achieve if it had to pace itself for a real-world task that lasted for a longer period of time — such as a 20-minute bout of gaming.
So far, so bad. However, a startup called GameBench reckons there’s another way. Its founders, who previously worked at chip companies like ARM and MediaTek, claim to have developed an “uncheatable” performance test that can be used to corroborate (or refute) the scores from traditional benchmarking apps, and which can help to rank Android phones and devices according to their true gaming capabilities. Although GameBench’s app is still in beta and likely won’t be released until the first quarter of next year, it has already collected scores for two devices, the HTC One and the Samsung Galaxy S 4. Ironically, as you’re about to see, Samsung may actually have less to fear from this cheat-free test than some of its rivals.
Filed under: Cellphones, Mobile, Samsung, HTC
Samsung has come under fire this week for allegedly inflating the benchmark scores for the Galaxy Note 3 among other Android devices, but — shocker — the company is not alone in enhancing scores. AnandTech just published a report that shows ASUS, HTC and other companies using the same “benchmark detect” function to artificially bump up the numbers. According to the site, virtually all OEMs run a CPU optimization on at least one of their devices, save for Apple, Google’s Nexus 4 and Nexus 7 and Motorola’s latest crop of phones. Dishonesty aside, though, what’s the big to-do about these inflated scores? AnandTech found that companies notched less than a 10-percent performance boost in AnTuTu and Vellamo. And when’s the last time you based your smartphone purchase on benchmark scores alone, anyway?
Filed under: Cellphones, Software, Mobile, Samsung, HTC, ASUS, Google
Via: 9 to 5 Google
Source: AnandTech
Samsung reportedly boosting Galaxy Note 3 benchmark performance by 20 percent
Posted in: Today's ChiliSamsung drew criticism for inflating the benchmark scores of Exynos devices earlier in the year, but the company appears undaunted; it’s reportedly boosting test numbers for other hardware as well. Ars Technica has discovered that the Snapdragon 800-based Galaxy Note 3 (and possibly the new Note 10.1) includes code that runs all CPU cores at full speed during certain benchmarks. The tweak gives the smartphone a minimum 20 percent higher score in any affected app, or enough to claim an artificially large advantage over an LG G2 using a similar chip. There may also be a graphics boost, Ars says. We’ve asked Samsung for its take on the findings. Whether or not the company responds, we don’t envy its position — it’s hard to form an alliance devoted to accurate mobile benchmarking when you’re accused of doctoring results.
Filed under: Cellphones, Mobile, Samsung
Source: Ars Technica
Since there aren’t many benchmarking apps for iOS, we totally understand if you resented 3DMark’s Android-only release in April. Good thing Futuremark finally launched an iOS counterpart, giving you a way to test hardware and pit the results directly against those of Windows and Android devices. The tool comes with three benchmarking modes that gauge CPU and GPU performance: the basic Ice Storm test, the more demanding Ice Storm Extreme and a new one called Ice Storm Unlimited, which lets you make chip-to-chip comparisons between phones and tablets. 3DMark will work with hardware running iOS 6.0 or higher (except if it’s a 4th-gen iPod touch), but you’ll need at least 174MB of free space. While this’ll surely make a lot of people happy, it’s not the end of the tool’s foray into new platforms — Futuremark plans to unleash a Windows RT version in the future.
Filed under: Cellphones, Tablets
Via: Shacknews
Source: iTunes
Overclocking may yield impressive benchmark results, but it turns out scores from Windows 8 PCs may not be reliable. The management at overclocking community HWBOT has discovered that tests provide inaccurate stats when then CPU base clock frequency is fiddled with from within the OS. Hardware-based real-time clocks (RTCs) help keep accurate track of time, but the operating system’s timekeeping somehow slows down or ramps up when processing speeds are tweaked. When underclocked by six percent, the outfit’s Haswell-infused system lagged 18 seconds behind actual time, fooling the benchmark into a higher score since it seemingly finished in a shorter period of time. Conversely, a boost to CPU speeds results in a lower mark as the internal timepiece ticks away faster than usual. However, modifying processor speeds at boot time avoids these issues.
As a result of the revelation, HWBOT is no longer accepting benchmarks from computers running the eighth iteration of Ballmer and Co.’s software, and will invalidate those already in its database. “Simply no benchmark – not even 3DMark – is unaffected by Microsoft’s RTC design decisions,” the outlet adds. The timing issues are said to stem from Windows 8’s support of disparate hardware setups, including embedded and budget PCs that don’t have a fixed RTC. If you’d like to see the inconsistencies for yourself, head past the break for video proof.
Filed under: Software, Microsoft
Via: ExtremeTech
Source: HWBOT
Benchmarks for the 2013 model Mac Pro surfaced back in June. At the time there was some mixed opinions in terms of those results. The Geekbench test had returned a score of 23,901 and while that was roughly 2,000 points above the previous Mac Pro flagship — some were expecting much higher numbers based on […]