Author name: Vincent Hindriksen

Mr. Vincent Hindriksen M.Sc is the founder of Stream HPC, a collective of performance engineering experts. Do you need expertise in performance engineering? We have several experts available (HPC, GPGPU, OpenCL, HSA, CUDA, MPI, OpenMP) and solve any kind of performance problem. Contact me directly to discuss further: +31 854865760, vincent@streamhpc.com or Skype

ROCm hipDNN - a network of rocks

Graph-based deep learning on AMD GPUs: building hipDNN’s normalization engine

Modern AI frameworks think in computation graphs, so the GPU libraries underneath them need to understand graphs too. AMD asked us to help accelerate hipDNN, its new graph-based deep-learning library for ROCm. We contributed a HIP-native engine for normalization operations and cut the time its test suite spends on the CPU by moving reference implementations

Graph-based deep learning on AMD GPUs: building hipDNN’s normalization engine Read More »

SPIR-V Logo.

Portable GPU binaries: SPIR-V support for AMD’s ROCm libraries

AMD’s SPIR-V adoption lets GPU software compile once and specialize on the device at runtime. But the ROCm libraries assumed the wavefront size was known at compile time, which broke SPIR-V compilation entirely. We refactored four of AMD’s core libraries to fix this, without any performance regression. In this case study we’ll give some insight on

Portable GPU binaries: SPIR-V support for AMD’s ROCm libraries Read More »

We made the world’s first 1 PFLOP/s FlashAttention on a single H100 GPU providing the fastest AI image generation possible

We worked on this project at the end of 2023 and in early 2024. NVIDIA’s Hopper GPUs had just been on the market, but popular AI frameworks offered little to no support for 8-bit inference at the time. Several other optimizations were also waiting for our attention. In this case study we’ll give some insight

We made the world’s first 1 PFLOP/s FlashAttention on a single H100 GPU providing the fastest AI image generation possible Read More »

Fast machine learning on Apple Silicon: building a Metal inference engine

We worked on this project from mid-2023, with the main effort through the end of September 2023. NVIDIA GPUs get most of the attention in AI, but our client wanted to bring fast generative AI to Apple’s Mac Studio. In this case study we explain how we built a Metal inference engine that beats Apple’s

Fast machine learning on Apple Silicon: building a Metal inference engine Read More »

Porting Molecular Dynamics Software to LUMI and FRONTIER Supercomputers

We ported molecular dynamics software (AMBER, GROMACS, OpenMM) from CUDA to AMD’s HIP framework for LUMI and FRONTIER supercomputers. All software achieved expected performance or better on AMD MI250X GPUs. We share some details about what we did for AMBER and OpenMM. Introduction For years, Nvidia dominated the supercomputing market. However, AMD gained significant traction

Porting Molecular Dynamics Software to LUMI and FRONTIER Supercomputers Read More »