Interesting stand-off between HardOCP and FiringSquad with regards to benchmarking. HOCP argues that real world testing is the way to go while jakub at FS sounds off about "real world" testing.
The rant article at FS
Jakub's Rant: 'Real-world' Benchmarking
The comments that supposedly started it off
And Kyle's rebuttal
[H] Enthusiast - Firing Squid Wastes their Ink
The rant article at FS
Jakub's Rant: 'Real-world' Benchmarking
The comments that supposedly started it off
HardOCP said:Let's just cut to the chase. You will see a lot of gaming benchmarks today that just simply lie to you. That is right, you will see frames per second numbers that are at best total BS, and at their worst a terrible representation of what difference a new Intel Core 2 processor will make in your gaming experience. The old ways of video game benchmarking do little to tell you about exactly how a new CPU will affect how you play your games or what experience your system supplies to you. Having more CPU power is a very cool thing, but being able to utilize it is not an easy thing to do nowadays.
And Kyle's rebuttal
[H] Enthusiast - Firing Squid Wastes their Ink