---
title: "#aiinfrastructure articles | Hashnode"
description: "Explore 22 articles tagged #aiinfrastructure on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/aiinfrastructure"
---

Tag

# #aiinfrastructure

22 posts · 0 followers

[Prasad Kukkala](https://hashnode.com/@techiesjournal) · [4d ago](https://hashnode.com/posts/google-tpus-are-coming-to-oracle-cloud-does-that-change-the-ai-lock-in-problem/6afc02cb6afb9763e1302bd7)

### [Google TPUs Are Coming to Oracle Cloud. Does That Change the AI Lock-In Problem?](https://techies-journal.hashnode.dev/google-tpus-are-coming-to-oracle-cloud-does-that-change-the-ai-lock-in-problem?utm_source=hashnode&utm_medium=feed)

Google TPUs are coming to Oracle Cloud in 2027. Learn what this changes for AI infrastructure, cloud lock-in, portability, and enterprise decisions.

15 min read · [techies-journal.hashnode.dev](https://techies-journal.hashnode.dev/google-tpus-are-coming-to-oracle-cloud-does-that-change-the-ai-lock-in-problem?utm_source=hashnode&utm_medium=feed)

[Jakson Tate](https://hashnode.com/@jakson-tate) · [Nov 13](https://hashnode.com/posts/nvidia-dynamo-distributed-llm-inference-bare-metal-guide/6af6e5b37a2abed6ee403560)

### [NVIDIA Dynamo Guide: Scaling Distributed LLM Inference on Bare Metal](https://servermo.hashnode.dev/nvidia-dynamo-distributed-llm-inference-bare-metal-guide?utm_source=hashnode&utm_medium=feed)

A complete SRE blueprint covering NIXL transports, KV cache tiering, Kubernetes v1beta1 orchestration, and observability for bare-metal GPU clusters.

13 min read · [servermo.hashnode.dev](https://servermo.hashnode.dev/nvidia-dynamo-distributed-llm-inference-bare-metal-guide?utm_source=hashnode&utm_medium=feed)

[Jakson Tate](https://hashnode.com/@jakson-tate) · [Nov 13](https://hashnode.com/posts/install-scale-nvidia-nemo-bare-metal-sre-guide/6af6e137b46d7596b78f245f)

### [How to Install and Scale NVIDIA NeMo on Bare Metal](https://servermo.hashnode.dev/install-scale-nvidia-nemo-bare-metal-sre-guide?utm_source=hashnode&utm_medium=feed)

A step-by-step SRE blueprint to deploy NeMo via Docker, scale with Megatron-Core 3D parallelism, tune RLHF memory, and fix OOM errors.

8 min read · [servermo.hashnode.dev](https://servermo.hashnode.dev/install-scale-nvidia-nemo-bare-metal-sre-guide?utm_source=hashnode&utm_medium=feed)

[Nathanael FETUE](https://hashnode.com/@nathanael-fetue) · [Oct 30](https://hashnode.com/posts/attaching-xdp-without-leaving-a-trace-bpf-link-kill-9-and-a-signal-mask-nobody-tests/6ae44cb13538dc023f94f887)

### [Attaching XDP without leaving a trace: bpf\_link, kill -9 and a signal mask nobody tests](https://pegasus-nathanael-tech.hashnode.dev/attaching-xdp-without-leaving-a-trace-bpf-link-kill-9-and-a-signal-mask-nobody-tests?utm_source=hashnode&utm_medium=feed)

Building AgentXDP, part 9. Previous: part 8, a lock-free queue broken on purpose. Next: part 10, a metrics endpoint a slow client cannot stall. An observability agent must do no harm. If it crashes, o

4 min read · [pegasus-nathanael-tech.hashnode.dev](https://pegasus-nathanael-tech.hashnode.dev/attaching-xdp-without-leaving-a-trace-bpf-link-kill-9-and-a-signal-mask-nobody-tests?utm_source=hashnode&utm_medium=feed)

[Weiwei Zhang](https://hashnode.com/@aicplight) · [Oct 9](https://hashnode.com/posts/nvidia-b200-vs-b300-vs-gb200-vs-gb300-what-changes-in-ai-cluster-networking/6ac8a6313512b38f6d2b230d)

### [NVIDIA B200 vs. B300 vs. GB200 vs. GB300: What Changes in AI Cluster Networking?](https://aicplight.hashnode.dev/nvidia-b200-vs-b300-vs-gb200-vs-gb300-what-changes-in-ai-cluster-networking?utm_source=hashnode&utm_medium=feed)

Compare NVIDIA B200, B300, GB200, and GB300 cluster architectures, including InfiniBand vs. Ethernet, 400G/800G networking, optical transceivers.

10 min read · [aicplight.hashnode.dev](https://aicplight.hashnode.dev/nvidia-b200-vs-b300-vs-gb200-vs-gb300-what-changes-in-ai-cluster-networking?utm_source=hashnode&utm_medium=feed)

[ZyVOP](https://hashnode.com/@zyvop) · [Sep 28](https://hashnode.com/posts/brick-the-llm-router-that-skips-the-cascade-and-still-cuts-your-bill/6ab9cf68f840d8a47dd6a33c)

### [Brick: The LLM Router That Skips the Cascade and Still Cuts Your Bill](https://blog.zyvop.com/brick-the-llm-router-that-skips-the-cascade-and-still-cuts-your-bill?utm_source=hashnode&utm_medium=feed)

How Regolo.ai's open-source router picks a model per query, and a benchmark metric worth understanding before you cite the headline number.

11 min read · [blog.zyvop.com](https://blog.zyvop.com/brick-the-llm-router-that-skips-the-cascade-and-still-cuts-your-bill?utm_source=hashnode&utm_medium=feed)

[ZyVOP](https://hashnode.com/@zyvop) · [Sep 25](https://hashnode.com/posts/can-a-2000-mini-pc-replace-your-ai-cloud-bill/6ab6a6c8488375a31a5b53f0)

### [Can a $2,000 Mini PC Replace Your AI Cloud Bill?](https://blog.zyvop.com/can-a-2000-mini-pc-replace-your-ai-cloud-bill?utm_source=hashnode&utm_medium=feed)

AMD's Strix Halo chips can run 120B-class models locally. Here's what the benchmarks, power costs, and real-world agent workflows actually look like.

11 min read · [blog.zyvop.com](https://blog.zyvop.com/can-a-2000-mini-pc-replace-your-ai-cloud-bill?utm_source=hashnode&utm_medium=feed)

[Joselo Martinez](https://hashnode.com/@joselozn) · [Sep 16](https://hashnode.com/posts/agentic-ai-beyond-the-hype-why-the-boundaries-are-key-in-deterministic-and-non-deterministic-behavior-for-agents/6aa9f0845ae9caa091ac0ba4)

### [Agentic AI Beyond the Hype: Why the Boundaries Are Key in Deterministic and Non-Deterministic Behavior for Agents](https://designednotmagic.hashnode.dev/agentic-ai-beyond-the-hype-why-the-boundaries-are-key-in-deterministic-and-non-deterministic-behavior-for-agents?utm_source=hashnode&utm_medium=feed)

90% of LLM systems fail in production due to rigid controls. Discover how to architect deterministic boundaries and handle uncertainty in your agents.

4 min read · [designednotmagic.hashnode.dev](https://designednotmagic.hashnode.dev/agentic-ai-beyond-the-hype-why-the-boundaries-are-key-in-deterministic-and-non-deterministic-behavior-for-agents?utm_source=hashnode&utm_medium=feed)

[2](https://hashnode.com/posts/agentic-ai-beyond-the-hype-why-the-boundaries-are-key-in-deterministic-and-non-deterministic-behavior-for-agents/6aa9f0845ae9caa091ac0ba4)

[Ivan Porta](https://hashnode.com/@gtrekter) · [Aug 27](https://hashnode.com/posts/from-ingress-to-inference-gateway-gateway-api-and-the-inference-extension/6a8fd785ca3ff895ff867ab8)

### [From Ingress to Inference Gateway: Gateway API and the Inference Extension](https://todea.hashnode.dev/from-ingress-to-inference-gateway-gateway-api-and-the-inference-extension?utm_source=hashnode&utm_medium=feed)

How Kubernetes networking became model-aware: the Gateway API resource model, the Inference Extension's InferencePool, and the endpoint picker that routes on KV-cache and queue metrics instead of round-robin.

19 min read · [todea.hashnode.dev](https://todea.hashnode.dev/from-ingress-to-inference-gateway-gateway-api-and-the-inference-extension?utm_source=hashnode&utm_medium=feed)

[Neural CoreTech](https://hashnode.com/@neuralcoretech) · [Jul 29](https://hashnode.com/posts/are-million-token-context-windows-taking-us-in-the-wrong-direction/6a6a17db165c3ac21575949a)

### [Are million-token context windows taking us in the wrong direction?](https://neuralcoretech.hashnode.dev/are-million-token-context-windows-taking-us-in-the-wrong-direction?utm_source=hashnode&utm_medium=feed)

How TokenMizer Introduces a Graph-Based Architecture for Long-Horizon AI Reasoning

1 min read · [neuralcoretech.hashnode.dev](https://neuralcoretech.hashnode.dev/are-million-token-context-windows-taking-us-in-the-wrong-direction?utm_source=hashnode&utm_medium=feed)
