---
title: "Ninad Ingale (@Electronholic) | Hashnode"
description: "Technophile. Read the latest articles by Ninad Ingale on Hashnode."
url: "https://hashnode.com/@Electronholic"
---

@Electronholic

# Ninad Ingale

@Electronholic · Birmingham, England · Joined December 2020

Technophile

## Comments

[Thanks for your reply, Karthik. Here is my response to this: When you're trying to decide whether to run your LLM inference on TPUs or GPUs, it really comes down to a few practical trade-offs: how predictable your batches are, your model's shape, and the distinct math behind the prefill and decode phases. If your workload is built around steady, high-volume traffic with fixed batch sizes and uniform sequence lengths, TPUs are absolute powerhouses. Thanks to their structured 2D or 3D mesh interconnects, they can crunch matrices at scale with incredible cost-efficiency for closed ecosystems. On the flip side, if you're dealing with chaotic chat traffic, ragged batching, and dynamic sequence lengths, GPUs give you the adaptability you need. Their flexible NVLink and NVSwitch setups make it much easier to handle custom attention mechanisms and shifting model shapes without hitting performance bottlenecks. While both architectures do great during the heavy lifting of the compute-bound prefill phase, the memory-bandwidth crunch during decode shifts the focus entirely to memory capacity per dollar and your serving stack. Ultimately, predictable, massive-scale production traffic makes TPUs a clear winner for your wallet, while rapid iteration and unpredictable request patterns make the flexibility of GPUs well worth it. Are you currently trying to optimise an inference pipeline for a specific model size, or looking at this from a cost-modelling perspective?](https://hashnode.com/posts/the-silicon-sorting-hat-demystifying-cpu-gpu-and-tpu-architectures/6abc547cfb83d5c19612a61c/comment/6abd56bd0c9cda7deaa0d133#reply-6ada929e5e0fca8687b0f3cc)

Reply · Article · Oct 22 · [The Silicon Sorting Hat: Demystifying CPU, GPU, and TPU Architectures](https://hashnode.com/posts/the-silicon-sorting-hat-demystifying-cpu-gpu-and-tpu-architectures/6abc547cfb83d5c19612a61c)

[Thank you LUBEGA TOM!](https://hashnode.com/posts/internet-of-things-iot-levels/6097f4ba21068818a5c6273c/comment/646261a7f72e54ac2a3044db#reply-648f0fb83039640aa8ca2c5b)

Reply · Article · Jun 18, 2023 · [Internet of Things (IoT) Levels](https://hashnode.com/posts/internet-of-things-iot-levels/6097f4ba21068818a5c6273c)

[An amazing article Jack Roper on Which Cloud Deployment Model Is Right for Your Business? ... simple, easy to understand and most of very knowledgeable! Must recommend article to read... just enjoy this article!](https://hashnode.com/posts/cloud-architectures/637c15ac2b0382694ed642e3/comment/6399ac5b34c83e4e6e7997bd)

Comment · Article · Dec 14, 2022 · [Cloud Architectures!](https://hashnode.com/posts/cloud-architectures/637c15ac2b0382694ed642e3)

[Thank you Manoj Ingale❤️](https://hashnode.com/posts/is-jina-ai-the-future-of-the-neural-search-concept/61d3afe546e56e75ab372c21/comment/61d45fad46e56e75ab374113#reply-61d49cb3220e9879776698f7)

Reply · Article · Jan 4, 2022 · [Is Jina AI the future of the neural search concept?](https://hashnode.com/posts/is-jina-ai-the-future-of-the-neural-search-concept/61d3afe546e56e75ab372c21)

[Thank you so much Edidiong Asikpo Mam.](https://hashnode.com/posts/announcing-harperdb-hackathon-on-hashnode/60b7961325dc276ffb940629/comment/60cb73022f8ab52fde40b98b#reply-60cb74212f8ab52fde40b9c0)

Reply · Article · Jun 17, 2021 · [Announcing HarperDB Hackathon on Hashnode!](https://hashnode.com/posts/announcing-harperdb-hackathon-on-hashnode/60b7961325dc276ffb940629)

[Any app would do right? There isn't any theme to make an app ain't it?](https://hashnode.com/posts/announcing-harperdb-hackathon-on-hashnode/60b7961325dc276ffb940629/comment/60cb73022f8ab52fde40b98b)

Comment · Article · Jun 17, 2021 · [Announcing HarperDB Hackathon on Hashnode!](https://hashnode.com/posts/announcing-harperdb-hackathon-on-hashnode/60b7961325dc276ffb940629)

[Thank you so much Abiola 😃](https://hashnode.com/posts/google-io-2021-everything-thats-been-revealed-at-the-keynote/60a52afa5c1fcb4077365822/comment/60a981285379f65d10b60051#reply-60a9eea25379f65d10b60744)

Reply · Article · May 23, 2021 · [Google I/O 2021: Everything that's been revealed at the keynote](https://hashnode.com/posts/google-io-2021-everything-thats-been-revealed-at-the-keynote/60a52afa5c1fcb4077365822)

[Thank you so much Andrew Baisden 😃](https://hashnode.com/posts/google-io-2021-everything-thats-been-revealed-at-the-keynote/60a52afa5c1fcb4077365822/comment/60a635b6b4e16849d76dc41d#reply-60a658d44e7f9549fc330e53)

Reply · Article · May 20, 2021 · [Google I/O 2021: Everything that's been revealed at the keynote](https://hashnode.com/posts/google-io-2021-everything-thats-been-revealed-at-the-keynote/60a52afa5c1fcb4077365822)

[Thank you so much Edidiong Asikpo😄](https://hashnode.com/posts/google-io-2021-everything-thats-been-revealed-at-the-keynote/60a52afa5c1fcb4077365822/comment/60a627a64e7f9549fc330688#reply-60a658c34e7f9549fc330e4a)

Reply · Article · May 20, 2021 · [Google I/O 2021: Everything that's been revealed at the keynote](https://hashnode.com/posts/google-io-2021-everything-thats-been-revealed-at-the-keynote/60a52afa5c1fcb4077365822)

[Hope I can stand somewhere in the Top 50😄.](https://hashnode.com/posts/developers-your-aprils-coffee-is-on-us/6076da354155da32fc83a36d/comment/60772433a3407a32d704205f)

Comment · Article · Apr 14, 2021 · [Developers, your April's Coffee is on us!](https://hashnode.com/posts/developers-your-aprils-coffee-is-on-us/6076da354155da32fc83a36d)
