Processors that can do 20+ GFLOPS per Watt (2012)

Reading Time: 4 minutes

System for communicating power-efficiency of new equipment. “A” being best, “F” being worst. 2011-A is incomparable with 2012-A.

For yearly power-usage there is a rule-of-thumb which states that a device that is continuously on, costs the amount of Watt times 1.5 in Euro per year. So the computer in front of me, that takes around 107 Watt, costs me €160 a year if I would leave it on. A moderate cluster with several GPUs of a few hundred Watts each, would cost a few thousand Euros a year. I would say: very doable for most companies.

So why is the performance per Watt? There is more to a Watt than just the costs. The energy to cool a cluster is quite high, as most of the energy escapes via heat. And then there is the increase in demand for portable power. In cases you are thinking of sweeping you credit card for a top 10 supercomputer, then these energy-costs are extremely high.

In this article I try to get an overview of who is entering the 20+ GFLOPS/Watt area. All processors that do less than 20 GFLOPS/Watt, need to have other advantages to survive. And you’ll see that all the green processors are programmed with OpenCL, the technology StreamHPC is all about.

IMPORTANT: The total power used is sometimes including and sometimes excluding memory-transfers. So the comparison below IS NOT FAIR. The graphics cards are including memory-transfers, while the CPUs and SoCs are not.

The list

Understand that since I mix CPUs, GPUs and SoCs (= CPU+GPU) the list is really only an indication of what is possible. Also a computer is built up of more energy-consuming parts than just the processors: interconnects, memory, harddrives, etc.

Disclaimer: The below list is incomplete and based on theoretical values. TDP is assumed to be consumed when processor is working at maximum performance. Actual FLOPS/Watt values can be much lower, depending on many factors. If you want to buy hardware specifically for the purpose of highest FLOPS/Watt have your software tested on the device.

ProcessorTypeYearGFLOPS (32bit)GFLOPS (64bit)Watt (TDP)GFLOPS/Watt (32bit)FLOPS/Watt (64bit)
Adapteva Epiphany-IVEpiphany2013100N/A250N/A
Movidius MyriadARM SoC: LEON3+SHAVE201215.28N/A0.3248N/A
Nvidia GT 630, 2nd revision (GK208)X86 GPU2013692?2527.68?
AMD Radeon HD 8970MX86 GPU20132304144100?231.44
Nvidia Tesla K10X86 GPU2012457719022520.34?
ZiiLabs ZMS-40ARM SoC201258N/A?20?N/A
ARM + MALI T604ARM SoC20128 + 68N/A4?19?N/A
NVidia GTX 690X86 GPU x 220125621234?30018.740.78
Geforce GTX TitanX86 GPU201345001300250185.2
GeForce GTX 680X86 GPU2012309012819515.850.65
AMD Radeon HD 7970 GHzX86 GPU201243001075300+14.33.58
Intel Xeon Phi 5110PX872012202210112258.994.49
AMD A10-5800K + HD 7660DX86 SoC2012121 + 614?1007.35?
Intel Core i7-3770 + HD4000X86 SoC2012225 + 294,4112 + 73.6776.742.41
NVIDIA CARMA (complete board)ARM + GPU2012? + 200?405.00?
IBM Power A2Power CPU2012204? 204553.72?3.72
Intel Core i7-3770X86 CPU2012225112???
AMD A10-5800KX86 CPU201212160????

Beware that the list is updated, while this text is not!

The list contains recent and general available processors, but I will add any processor you want to see in the list – just request them in a comment.

Please also point me to sources where official data can be found on these processors, as it seems to be top-secret data. As not all the data was available, I had to make some guesses.

Below you find a graph of the list, including architectures grouped by GFLOPS + GFLOPS/Watt.

GFLOPS/Watt for 32-bit. Red: CPUs, orange: APUs, yellow: GPUs, light-blue: ARM, green: grid-processors, not circled: Phi. The upper-right area is where we need to go.

Below is a maybe more interesting view: Watt/GFLOPS. This projection has the advantage that low-power processors (< 2Watt) don’t get overrated and are closer together.

Watt/GFLOPS (lower is better) vs GFLOPS, excluding the CPUs. You see the Radeons doing best if it comes to performance and Watt/GFLOPS. The left-upper area is where we need to go.

CPU vs GPU

Let’s be clear:

  1. A GPU needs a CPU as a host.
  2. A GPU is great in vector-computations, a CPU much better in scalar computations.
In other words, a mix between a scalar and a vector processor is best. But once a problem can be defined as a vector-problem, the GPU is much, much faster than a CPU.

64 bit vs 32 bit

As the memory-usage is energy-consuming and results in half the number of data showing up at the processor, we have two reasons why more energy is consumed. Due to architecture-differences, CPUs have a penalty for 32 bit and GPUs a penalty for 64 bit.

Notice that most X86-alternatives have no 64 bit support, or just recently started with it. GPUs crunch double precision numbers at a fourth or less of the 32-bit performance-roof.

Architectures

ARM, X86/X87, Power and Epiphany all have different architecture-choices to get their targeted trade-off between precision, power-consumption and performance-optimisation (control unit). These choices make it sometimes impossible to get with the pace of other architectures in a certain direction.

Current winner: Adapteva Epiphany

Their 64-core Epiphany-IV is programmable with OpenCL (buggy compiler though) and the 50 GFLOPS/Watt makes it worth to put time in porting software if you need a portable device. People who have ported their software to OpenCL already have an advantage here. Adapteva even claims 72 GFLOPS/Watt, as you can read here. With a 100-core CPU coming up, they will probably even raise the bar.

X86 CPUs have the advantage of precision and legacy code, of which precision is the biggest advantage. As X86 GPUs (with Nvidia on top) have a great performance/Watt entering the 20+ GFLOPS/Watt, this could be very interesting for defending the X86 market against ARM.

ARM-processors have a lot of software written for it (via Android) and is very flexible in design, while keeping power-usage for the CPU-part around 1Watt. For instance ZiiLabs’ processor can be compared to the design of Adapteva, but then with an ARM-CPU attached to it.

Conclusion

There is much more than just this number of GFLOPS/Watt, and which architecture will be mainstream architecture in a few years one can only speculate on. Luckily recompiling for other architectures is getting easier with compiler-technologies such as LLVM, so we don’t need to worry too much. Except to redesign our software for multi-core of course. You have read above that new architectures are programmed with OpenCL. It is better to invest in this technology now than later.

The LEAP-conference is all about exactly this subject. Meet StreamHPC at this very unique event on 21 May 2013.

More reading

As memory-access takes energy, minimising memory-calls can lower consumption. This article on the ARM blog explains how this is done with MALI GPUs.

The Mont Blanc project is a supercomputer based on ARM. This 12 page PDF shows some numbers and specifications of this supercomputer.

As supercomputers eat lots of power, The Green 500 tries to stimulate to build greener HPC.

 

Related Posts

AMD-Intel-NVidia

The most noticeable processors from NVIDIA, AMD and Intel

...  I want to shortly discuss the most noticeable processors from each of the big three.The reason for this blog-post is ...

arm_mali_cover_151112297646_640x360

Scaling mobile GPUs to 1000 GFLOPS

...  special attention. OpenCL on ARM: Growth-expectation of GFLOPS/Watt of mobile GPUs exceeds Moore's law. That's ...

CMD

Intel’s answer to AMD and NVIDIA: the XEON Phi 5110P

...  (VLIW). At 1.053 GHz this gives 1.050 * 60 * 8 * 2 = 1011 GFLOPS.The above 2 is because it is capable of doing MAD-operations: ...

OpenCLonFPGAs

OpenCL on Altera FPGAs

...  or Field Programmable Gate Arrays, are processors that are programmed on a hardware-level instead of software-level. ...  ...