Tag

#rocm

10 posts0 followers

Explore Hashnode

Alternatives

Installing Docker with ROCm GPU Support on Ubuntu 24.04

Docker is a platform that packages applications and their dependencies into isolated containers so they run consistently on any system. GPU-enabled containers extend this by giving containerized appli

vultr.hashnode.dev

Vedant JadhavOct 3 · 7 min read

What 57 LLM Benchmark Runs on an AMD Instinct MI300X Taught Me About VRAM, Throughput, and Quantization

How much VRAM does a model actually need? How does model size affect generation speed? Does quantization always reduce memory? Does lower precision always make inference faster? I wanted to answer the

3 vedantjadhav.hashnode.dev

Sanskriti HarmukhSep 16 · 3 min read

Installing TensorFlow with ROCm Acceleration on Ubuntu 24.04

TensorFlow is an open-source framework widely used for building and training machine learning models, including deep learning. ROCm is AMD's platform for GPU computing, designed to deliver high-perfor

vultr.hashnode.dev

Sanskriti HarmukhSep 16 · 3 min read

Installing PyTorch with ROCm Acceleration on Ubuntu 24.04

PyTorch is an open-source framework for building and training machine learning models, especially deep learning networks. ROCm is AMD's platform for GPU computing, enabling high-performance computing

vultr.hashnode.dev

Sanskriti HarmukhSep 16 · 3 min read

Installing JAX with ROCm Acceleration on Ubuntu 24.04

JAX is an open-source library for high-performance numerical computing and machine learning research, offering tools for automatic differentiation, GPU/TPU acceleration, and just-in-time compilation.

vultr.hashnode.dev

Manu ShuklaJul 28 · 14 min read

ROCm vs CUDA in 2026: can enterprises actually escape CUDA lock-in?

ROCm vs CUDA in 2026: can enterprises actually escape CUDA lock-in? Summary. CUDA has been NVIDIA's real moat for 18 years, and 2026 is the first year that moat has visible cracks. AMD's ROCm 7, relea

ecorpit.hashnode.dev

Brian KingJul 9 · 9 min read

Installing ROCm & Llama.cpp for CPUs & APUs.

Abstract. I document my complete workflow for installing AMD ROCm drivers on Ubuntu Desktop 24.04 LTS and building the llama.cpp library with HIP (GPU) backend support for my AMD Strix Halo APU with i

solodev.app

Brian KingJul 9 · 12 min read

Installing vLLM onto EVO-X2.

Abstract. I download a vLLM Docker image that supports AMD, and the ROCm GPU driver that runs on the Strix Halo platform (AI Max+ 395 APU). I connect the running Docker container to local GGUF AI mode

solodev.app

Mark KimSep 23, 2023 · 1 min read

Stable Diffusion, AMD, and nod.ai

Background Previously, I failed to get anything running using AMD and ROCm for stable diffusion. One suggestion online was using nod.ai SHARK, which uses IREE to run ML through Vulkan. SHARK supports Radeon out of the box, so I decided to give it a t...

m-kim.hashnode.dev

Search Hashnode

Explore Hashnode

Installing Docker with ROCm GPU Support on Ubuntu 24.04

What 57 LLM Benchmark Runs on an AMD Instinct MI300X Taught Me About VRAM, Throughput, and Quantization

Installing TensorFlow with ROCm Acceleration on Ubuntu 24.04

Installing PyTorch with ROCm Acceleration on Ubuntu 24.04

Installing JAX with ROCm Acceleration on Ubuntu 24.04

ROCm vs CUDA in 2026: can enterprises actually escape CUDA lock-in?

Installing ROCm & Llama.cpp for CPUs & APUs.

Installing vLLM onto EVO-X2.

Stable Diffusion, AMD, and nod.ai

Trending tags this week