---
title: "#gpu-optimization articles | Hashnode"
description: "Explore 9 articles tagged #gpu-optimization on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/gpu-optimization"
---

Tag

# #gpu-optimization

9 posts · 0 followers

[Akshay Suryawanshi](https://hashnode.com/@akshaysuryawanshi) · [Oct 16](https://hashnode.com/posts/from-replicas-to-fp8-my-first-vllm-performance-investigation/6ad2ae0da305ffe6691825e0)

### [From Replicas to FP8: My First vLLM Performance Investigation](https://akshaysuryawanshi.hashnode.dev/from-replicas-to-fp8-my-first-vllm-performance-investigation?utm_source=hashnode&utm_medium=feed)

Testing vLLM replicas, NVIDIA MPS, and FP8 KV cache and attention on one laptop GPU, measuring throughput, latency, goodput, and answer quality.

10 min read · [akshaysuryawanshi.hashnode.dev](https://akshaysuryawanshi.hashnode.dev/from-replicas-to-fp8-my-first-vllm-performance-investigation?utm_source=hashnode&utm_medium=feed)

[vikas sharma](https://hashnode.com/@vikasty) · [Oct 13](https://hashnode.com/posts/building-efficient-ai-infrastructure-with-gpu-cloud-computing/6acdc6b69a5b9feded686fa8)

### [Building Efficient AI Infrastructure with GPU Cloud Computing](https://vkdigiservices.hashnode.dev/building-efficient-ai-infrastructure-with-gpu-cloud-computing?utm_source=hashnode&utm_medium=feed)

A technical guide to selecting GPU resources, reducing bottlenecks, and improving cloud computing efficiency.

7 min read · [vkdigiservices.hashnode.dev](https://vkdigiservices.hashnode.dev/building-efficient-ai-infrastructure-with-gpu-cloud-computing?utm_source=hashnode&utm_medium=feed)

[Marc Wojcik](https://hashnode.com/@thecgaigroup) · [Jul 27](https://hashnode.com/posts/kubernetes-gpu-utilization-cost-optimization/6a67851dbe2bda592962563a)

### [The 5% Problem: Why Kubernetes GPU Utilization Is So Low](https://blog.thecgaigroup.com/kubernetes-gpu-utilization-cost-optimization?utm_source=hashnode&utm_medium=feed)

Enterprises are pouring $2 trillion into AI infrastructure while GPU utilization sits at just 5 percent. Here is how to fix it.

13 min read · [blog.thecgaigroup.com](https://blog.thecgaigroup.com/kubernetes-gpu-utilization-cost-optimization?utm_source=hashnode&utm_medium=feed)

[Fabio Sarmento](https://hashnode.com/@sarmento) · [May 1](https://hashnode.com/posts/exploring-nvidia-h200-maximizing-282gb-of-vram-for-ai-models/69f487d8ec5c73f17628ec90)

### [Exploring Nvidia H200: Maximizing 282GB of VRAM for AI Models](https://sarmento.hashnode.dev/exploring-nvidia-h200-maximizing-282gb-of-vram-for-ai-models?utm_source=hashnode&utm_medium=feed)

Introduction The recent advancements in GPU technology have set new standards for performance, especially in the realm of artificial intelligence (AI). Nvidia's H200 GPU, boasting an impressive 282GB of VRAM, is a game-changer for developers focusing...

3 min read · [sarmento.hashnode.dev](https://sarmento.hashnode.dev/exploring-nvidia-h200-maximizing-282gb-of-vram-for-ai-models?utm_source=hashnode&utm_medium=feed)

[Roanak Baviskar](https://hashnode.com/@roanak) · [Feb 17](https://hashnode.com/posts/gpu-utilization-is-a-misleading-metric/6994c2b594993ba9dd1ad68e)

### [GPU Utilization is a Misleading Metric](https://blog.trainy.ai/gpu-utilization-is-a-misleading-metric?utm_source=hashnode&utm_medium=feed)

At Trainy, we work on infrastructure for managing GPU clusters, so we spend a lot of time thinking about this stuff. Last year we were working with a foundation model company to scale out and improve the efficiency of their LLM training. We went thro...

7 min read · [blog.trainy.ai](https://blog.trainy.ai/gpu-utilization-is-a-misleading-metric?utm_source=hashnode&utm_medium=feed)

[Taufiq](https://hashnode.com/@taufiq) · [Sep 8, 2025](https://hashnode.com/posts/pybuddy-local-ai-coding-assistant/68bf37731ddd3b0e1faffd04)

### [PyBuddy: A Local-First LLM Coding Assistant for Everyone](https://taufiq.hashnode.dev/pybuddy-local-ai-coding-assistant?utm_source=hashnode&utm_medium=feed)

Discover PyBuddy, a local-first LLM code assistant for Python coding, offering privacy, flexibility, and free use on your own device

6 min read · [taufiq.hashnode.dev](https://taufiq.hashnode.dev/pybuddy-local-ai-coding-assistant?utm_source=hashnode&utm_medium=feed)

[Akash Pawar](https://hashnode.com/@akash202k) · [Jul 26, 2025](https://hashnode.com/posts/nvidia-tesla-gpu-scheduling-from-hpc-to-kubernetes-with-volcano-mlops/6884896c427b8b400427115a)

### [NVIDIA Tesla GPU Scheduling: From HPC to Kubernetes with Volcano MLOps](https://blog.akashpawar.com/nvidia-tesla-gpu-scheduling-from-hpc-to-kubernetes-with-volcano-mlops?utm_source=hashnode&utm_medium=feed)

Implementing Gang Scheduling for Distributed GPU Training on Amazon EKS

4 min read · [blog.akashpawar.com](https://blog.akashpawar.com/nvidia-tesla-gpu-scheduling-from-hpc-to-kubernetes-with-volcano-mlops?utm_source=hashnode&utm_medium=feed)

[Tanvi Ausare](https://hashnode.com/@tanvi-ausare) · [Mar 21, 2025](https://hashnode.com/posts/innovative-gpu-strategies-to-tackle-the-memory-wall-in-deep-learning/67dd2e787c5945dfc30656bc)

### [Innovative GPU Strategies to Tackle the Memory Wall in Deep Learning](https://neevcloud.hashnode.dev/innovative-gpu-strategies-to-tackle-the-memory-wall-in-deep-learning?utm_source=hashnode&utm_medium=feed)

Innovative strategies to address GPU memory bottlenecks include dynamic allocation, AI-driven techniques, and performance enhancement

8 min read · [neevcloud.hashnode.dev](https://neevcloud.hashnode.dev/innovative-gpu-strategies-to-tackle-the-memory-wall-in-deep-learning?utm_source=hashnode&utm_medium=feed)

[Kevin Loggenberg](https://hashnode.com/@TheCodesmith) · [Feb 27, 2025](https://hashnode.com/posts/why-onnx-runtime-is-a-good-choice-for-cross-platform-compatibility/67c0464c00fbc77b2d5d5361)

### [Why ONNX Runtime Is a Good Choice for Cross-Platform Compatibility](https://thecodesmith.hashnode.dev/why-onnx-runtime-is-a-good-choice-for-cross-platform-compatibility?utm_source=hashnode&utm_medium=feed)

Deploying Efficient AI Inference Across Cloud, Edge, and Mobile Devices.

15 min read · [thecodesmith.hashnode.dev](https://thecodesmith.hashnode.dev/why-onnx-runtime-is-a-good-choice-for-cross-platform-compatibility?utm_source=hashnode&utm_medium=feed)

[Tanvi Ausare](https://hashnode.com/@tanvi-ausare) · [Feb 7, 2025](https://hashnode.com/posts/let-ai-optimize-your-code-for-gpus/67a5ec8db81aef26c4623466)

### [Let AI Optimize Your Code for GPUs](https://neevcloud.hashnode.dev/let-ai-optimize-your-code-for-gpus?utm_source=hashnode&utm_medium=feed)

AI revolutionizes GPU optimization, boosting performance and efficiency via automated code advancements and specialized tools across industries

7 min read · [neevcloud.hashnode.dev](https://neevcloud.hashnode.dev/let-ai-optimize-your-code-for-gpus?utm_source=hashnode&utm_medium=feed)
