In 1 week I tried to order a Raspberry Pi 2 and visited the Science Museum where I saw Pegasus, the last commercial machine built with valves. I wondered what the relative performance was. I remembered that the first machine I worked on, the VAX 11/780 was the original unit of 1 MIP. That unit worked until RISC processors with higher clock rates but simpler instruction sets started skewing the data by claiming higher MIP ratings. DEC redefined the VAX-only MIP, the VUP.
Understandably, some manufacturers like to exaggerate performance of new processors but over time they get benchmarked, but using changing benchmarks. As the data becomes less commercially sensitive, I’d imagine there would be greater honesty, so makers can show off about the multiples of performance of their newer toys.
Wouldn’t it be nice if there was a site that recorded relative performance over time, allowed comparisons, graphed improvements etc.? If there is then please tell me where.