How we test: What do our scores mean?

High Performance Laptops continues to rapidly evolve. One of the new features we’re starting to implement is an at-a-glance, Review box with ratings (at the bottom of the review). But what do these ratings mean?

We score everything out of five using mathematical formulae based on multiple criteria. At the time of publishing, everything – including performance, ergonomics, portability and value – is mathematically compared to every laptop we’ve reviewed. This means five stars is the best score out of everything on the market while one star is the worst.

2D Performance

We typically use three tests for 2D performance. For general performance there’s PCMark 10 which provides a good idea of a systems all-round capabilities. We also use Cinebench R15 which is like a processor drag-race for rendering a 3D scene – high clock speeds and especially, multiple cores (and Hyper-Threading) help here. Then there’s Cinebench R23 which is similar but runs the test for 10 minutes. This helps establish whether performance degrades over time as heat increases. It should be noted that the star-rating denotes how fast it is compared to the rest of the market AT THE TIME OF THE REVIEW. A 5-Star performance by a year-old product will not be comparable to a new product with a 5-Star performance rating.

3D Performance

We use 3D Mark tests for this: Time Spy (default), FireStrike Extreme and Port Royal. While its heavily GPU influenced, fast, supporting components and a stable system will enhance any scores. As with 2D performance, the score is accurate at the time of the review. Note that Port Royal’s Ray Tracing nature currently favours Nvidia GPUs (which are dominant on the market). We are currently in the process of adding Far Cry 6 tests to the mix and will update the scores once a methodology has been settled upon.

Ergonomics

The human factor. How does it look? How does it feel to use? What does it sound like? We create this score according to the following criteria.

5 points for awesome looks
5 points for corporate looks
5 points for ports
5 points for RGB
5 points for noise
5 points for speakers
5 points for heat
5 points for hard drive
10 points for screen
10 points for keyboard
5 points for trackpad
2 points for touch screen
5 Bonus points (Warranty, Green waste, Stylus, Miscellaneous)

Stability

This is a big issue for high performance laptops. You can’t just put a bunch of powerful, hot components in a small box and expect them to just work in harmony continuously. They’re going to get very hot. While elaborate laptop cooling systems are continuing to improve in terms of cooling efficiency and noise, there are still too many laptops that get too hot and slow down due to thermal throttling or wind-up fans to annoying levels periodically to cool things down. While this is better than the old days when they simply crashed when they got too hot, we expect a high performance laptop to do what it does without significant impact on usage. To this end, we run torture tests and if performance degrades, it loses points.

Portability

The first high performance gaming laptops were big, bulky, had huge power bricks and large batteries that powered the machines for around 10 to 30 minutes. The batteries were more like UPS systems, really. Nowadays, we’re seeing gaming laptops last for almost two days away from the mains! However, we don’t expect any laptop to actually run games without power so we test the battery using PCMark 10’s Modern Office test which is essentially, basic office work. As this website is about High Performance Laptops we’re quite forgiving on weight. This rating is an average based upon 50% of the battery life rating, 40% of the weight rating, 5% of the power brick weight rating and 10% of the build quality rating.

Value

High Performance Laptops are expensive and so we normalise the price to avoid cheap-and-slow laptops skewing the results too much. The Value score factors multiplies the price rating by 45% of the important 3D Performance score, 30% of the 2D Performance score, 5% of the Stability score, 5% of the Portability Score and 15% of the Ergonomics Score.

Overall

This is an average of all other scores.

Please note that this scoring system is relatively new and so won’t appear on older reviews.

Leave a Reply