Case Studies

ROCm hipDNN - a network of rocks

Graph-based deep learning on AMD GPUs: building hipDNN’s normalization engine

Modern AI frameworks think in computation graphs, so the GPU libraries underneath them need to understand graphs too. AMD asked us to help accelerate hipDNN, its new graph-based deep-learning library for ROCm. We contributed a HIP-native engine for normalization operations and cut the time its test suite spends on the CPU by moving reference implementations

Graph-based deep learning on AMD GPUs: building hipDNN’s normalization engine Read More »

SPIR-V Logo.

Portable GPU binaries: SPIR-V support for AMD’s ROCm libraries

AMD’s SPIR-V adoption lets GPU software compile once and specialize on the device at runtime. But the ROCm libraries assumed the wavefront size was known at compile time, which broke SPIR-V compilation entirely. We refactored four of AMD’s core libraries to fix this, without any performance regression. In this case study we’ll give some insight on

Portable GPU binaries: SPIR-V support for AMD’s ROCm libraries Read More »

We made the world’s first 1 PFLOP/s FlashAttention on a single H100 GPU providing the fastest AI image generation possible

We worked on this project at the end of 2023 and in early 2024. NVIDIA’s Hopper GPUs had just been on the market, but popular AI frameworks offered little to no support for 8-bit inference at the time. Several other optimizations were also waiting for our attention. In this case study we’ll give some insight

We made the world’s first 1 PFLOP/s FlashAttention on a single H100 GPU providing the fastest AI image generation possible Read More »

Fast machine learning on Apple Silicon: building a Metal inference engine

We worked on this project from mid-2023, with the main effort through the end of September 2023. NVIDIA GPUs get most of the attention in AI, but our client wanted to bring fast generative AI to Apple’s Mac Studio. In this case study we explain how we built a Metal inference engine that beats Apple’s

Fast machine learning on Apple Silicon: building a Metal inference engine Read More »

Porting Molecular Dynamics Software to LUMI and FRONTIER Supercomputers

We ported molecular dynamics software (AMBER, GROMACS, OpenMM) from CUDA to AMD’s HIP framework for LUMI and FRONTIER supercomputers. All software achieved expected performance or better on AMD MI250X GPUs. We share some details about what we did for AMBER and OpenMM. Introduction For years, Nvidia dominated the supercomputing market. However, AMD gained significant traction

Porting Molecular Dynamics Software to LUMI and FRONTIER Supercomputers Read More »

We accelerated the OpenCL backend of pyPaSWAS sequence aligner

Last year we accelerated the OpenCL-code in PaSWAS, which is open source software to do DNA/RNA/protein sequence alignment and trimming. It has users world-wide in universities, research groups and industry. Below you’ll find the benchmark results of our acceleration work. You can also test out yourself, as the code is public. In the readme-file you

We accelerated the OpenCL backend of pyPaSWAS sequence aligner Read More »

Learn about AMD’s PRNG library we developed: rocRAND – includes benchmarks

When CUDA kept having a dominance over OpenCL, AMD introduced HIP – a programming language that closely resembles CUDA. Now it doesn’t take months to port code to AMD hardware, but more and more CUDA-software converts to HIP without problems. The real large and complex code-bases only take a few weeks max, where we found

Learn about AMD’s PRNG library we developed: rocRAND – includes benchmarks Read More »