@Venkat2811

Venkat Raman

@Venkat2811Berlin, GermanyJoined July 2022

Research & Engineering - LLM Inference & High Performance systems.

About

🧑‍💻 Research & Engineering - LLM Inference & High Performance systems. |📍Berlin 🇩🇪 | 📚 https://venkat.eu | 💬 https://twitter.com/Venkat2811

Available for

Nothing here yet.

Venkat Raman's blogs

Venkat's Blogvenkat.eu11 posts

Experimenting with bearblog for now

https://venkat-systems.bearblog.dev/

Jan 15 · 1 min readvenkat.eu

Essential Math & Concepts for LLM Inference

(Image Credit: HF TGI Benchmark) Introduction As enterprises and tech enthusiasts increasingly integrate LLM applications into their daily workflows, the demand for TFLOPS is ever increasing. Apple, Microsoft, Google, and Samsung have already introdu...

May 31, 2024 · 12 min readvenkat.eu

The power of Mechanical Sympathy in Software Engineering

Introduction Modern software programming languages, compilers, and frameworks abstract away underlying complexities and details, allowing developers to focus on building systems and applications to solve business problems. This design enables enginee...

Apr 18, 2024 · 22 min readvenkat.eu

CPU & GPU - The Basics

Introduction In this article, we'll go through some fundamental low level details to understand why GPUs are good at Graphics, Neural Network and Deep Learning tasks and CPUs are good at wide number of sequential, complex general purpose computing ta...

Apr 8, 2024 · 16 min readvenkat.eu

OS Error: Too many open files. Understanding file and socket descriptors.

Intro Engineers who've built, deployed and operated backend services would've encountered this error. It usually means your service is serving real user requests - Yay 🎉 ! One possible scenario is - you need to fine-tune server OS configuration to s...

Mar 26, 2024 · 7 min readvenkat.eu

Venkat Raman

About

Available for

Venkat Raman's blogs

Experimenting with bearblog for now

Essential Math & Concepts for LLM Inference

The power of Mechanical Sympathy in Software Engineering

CPU & GPU - The Basics

OS Error: Too many open files. Understanding file and socket descriptors.

Search Hashnode

Venkat Raman

About

Available for

Venkat Raman's blogs

Experimenting with bearblog for now

Essential Math & Concepts for LLM Inference

The power of Mechanical Sympathy in Software Engineering

CPU & GPU - The Basics

OS Error: Too many open files. Understanding file and socket descriptors.