We are happy to introduce a new smartphone rating system on PhoneArena, which came into effect from the end of September 2023!
This new system represents a complete overhaul of how smartphones are rated and takes into account more nuance and detail, as we now rate smartphones across 12 different categories with carefully selected criteria to ensure all devices are treated equally. the same way and minimize personal bias.
So, what is this new PhoneArena smartphone review system and how does it work?
After careful consideration, we have defined 12 fundamental categories that describe our modern smartphone experience:
Each of these categories has a different weight in the scoring system, and some categories have greater importance than others for the score. This is where we had to use our judgment and the opinions of our readers to find a balance that reflects the way most people use their phones. For example, the battery life of a device is a very important category that weighs more than charging speed. Both are important, but we think most people have set their priorities this way.
At the moment you can still only see the final, holistic score in our reviews, but we will soon introduce a new visualization where you can see a breakdown of scores by category.
Is the price of a device taken into account in the bill?
No.
We’re not stopping there and will also show you more context for each partition, so you also get an idea of where the device stands among its peers. And remember that often a lower score corresponds to the lower class of the device, but it can still outperform its peers!
Explain each category
So let us quickly guide you through all the individual categories:
Category 1: Daily performance
The perceived speed and smoothness of simple everyday smartphone tasks like calling, emailing, browsing, and social media.
For this category, we evaluate the phone’s performance in everyday tasks. The questions we ask ourselves when developing a score in this category are:
- Do the apps load quickly?
- Is the scrolling smooth?
- How does gesture navigation work?
- Is there overheating with simple tasks?
Category 2: Extreme performance
How well does the phone perform for heavy tasks and gaming
We have a separate category measuring more intense tasks and this score is based on a weighted mix of benchmark scores.
In the mix we have CPU performance tests and GPU/gaming related benchmarks.
Category 3: Battery life
How long does it last?
Every phone we review undergoes three battery tests. Using specialist equipment and software, we set each phone to a fixed brightness level to ensure a level playing field and all phones are connected to a Wi-Fi network for these tests.
Test #1: Web browsing — we run a script that iterates through a set of web pages and scrolls at predefined intervals, mimicking a real browsing session. This is our lightest battery test.
Test #2: Video streaming — we stream the same video playlist over Wi-Fi and with the same video quality across the entire screen size, and measure the lifespan of phones.
Test #3: 3D games — we run a popular game title at the same graphics settings and in the same environment/level on every phone we test. This test puts a strain on the GPU.
Based on these three results, we establish a final battery score for this category.
Category 4: Charging speed
We measure and classify
We use the manufacturer’s recommended charger and the cable provided in the box to measure the phone’s charging time from 1% to 100%. Based on the results, each phone is assigned a score.
Category 5: Wireless Charging Speed
We’re also testing wireless charging speed!
We use the manufacturer’s recommended wireless charger to measure the phone’s charging time from 1% to 100%. Based on the results, each phone is assigned a score.
Category 6: Camera – Photo quality
Rating an image is difficult, but we have a complex new system just for that
We’ve created a complex new system that looks at various aspects of image quality and we get a score based on extensive testing. We will soon introduce this new camera rating system with all the exciting details associated with it, so stay tuned!
Category 7: Camera – Video quality
How good is the video on a scale of 1 to 10?
Just like we did with photo quality, we now have a new rating system for video quality. Expect a lot more detail to be provided in a separate article where you’ll learn what exactly goes into this all-new video quality rating!
Category 8: Display quality
We perform a number of laboratory tests measuring various screen characteristics
We use professional equipment and software to measure the characteristics of a phone screen: maximum brightness, minimum brightness, color accuracy, etc.
Category 9: Biometrics
Fingerprint and Face ID performance ranked by performance and accuracy
We test the performance of a phone’s fingerprint scanner or facial recognition system for speed and accuracy, and assign a score based on the results.
Category 10: Audio quality
Evaluating a Phone Speaker System
We test the phone’s speakers and assign a score based on volume, sound quality and richness. The rating is based on typical smartphone speaker performance.
Category 11: Software and updates
Software update commitment is important
We study the software update commitment for each phone and examine whether there are any limiting factors to the software experience, such as a ban on core apps or other major software restrictions. Each phone is assigned a score based on this.
Category 12: Design
Build quality, materials, appearance
How well designed is this phone? This can be a subjective matter, but we have a set of criteria that help us establish a rating based on construction quality, materials used, special design elements, etc.
You have questions ?
You will soon see a new graph with each review that shows the individual scores for each category and you will clearly understand why each smartphone review score is the way it is. We are working to deliver it to you in the coming months.
During the first few months of using this system, you will also see a disclaimer right after the introductory paragraph of a review specifically stating when a smartphone’s score is based on the new system. Older reviews may still use our old rating system, which is why at present direct comparisons of many scores are not possible. However, we will re-evaluate older devices based on the new system over the coming weeks and update this article once the process is complete.
Plus, we’ll be happy to explain the details to you, so don’t hesitate to ask! And… tell us what you think of this new system! Do you like to? Is there anything else you would have included? The comments section is now officially open!
