Venkat Raman

@Venkat2811

Research & Engineering - LLM Inference & High Performance systems.

Berlin, GermanyJoined July 2022

About

🧑‍💻 Research & Engineering - LLM Inference & High Performance systems. |📍Berlin 🇩🇪 | 📚 https://venkat.eu | 💬 https://twitter.com/Venkat2811

Available for

Nothing here yet.

Venkat Raman's blogs

Venkat's Blogvenkat.eu11 posts

Articles Comments

Recently published

VRVenkat Ramanvenkat.euJan 15 · 1 min read

Experimenting with bearblog for now

https://venkat-systems.bearblog.dev/

0

VRVenkat Ramanvenkat.euMay 31, 2024 · 12 min read

Essential Math & Concepts for LLM Inference

(Image Credit: HF TGI Benchmark) Introduction As enterprises and tech enthusiasts increasingly integrate LLM applications into their daily workflows, the demand for TFLOPS is ever increasing. Apple, Microsoft, Google, and Samsung have already introdu...

0

VRVenkat Ramanvenkat.euApr 18, 2024 · 22 min read

The power of Mechanical Sympathy in Software Engineering

Introduction Modern software programming languages, compilers, and frameworks abstract away underlying complexities and details, allowing developers to focus on building systems and applications to solve business problems. This design enables enginee...

0

VRVenkat Ramanvenkat.euApr 8, 2024 · 16 min read

CPU & GPU - The Basics

Introduction In this article, we'll go through some fundamental low level details to understand why GPUs are good at Graphics, Neural Network and Deep Learning tasks and CPUs are good at wide number of sequential, complex general purpose computing ta...

0

VRVenkat Ramanvenkat.euMar 26, 2024 · 7 min read

OS Error: Too many open files. Understanding file and socket descriptors.

Intro Engineers who've built, deployed and operated backend services would've encountered this error. It usually means your service is serving real user requests - Yay 🎉 ! One possible scenario is - you need to fine-tune server OS configuration to s...

0

Venkat Raman

About

Available for

Venkat Raman's blogs

Recently published

Experimenting with bearblog for now

Essential Math & Concepts for LLM Inference

The power of Mechanical Sympathy in Software Engineering

CPU & GPU - The Basics

OS Error: Too many open files. Understanding file and socket descriptors.

Search Hashnode

Venkat Raman

About

Available for

Venkat Raman's blogs

Recently published

Experimenting with bearblog for now

Essential Math & Concepts for LLM Inference

The power of Mechanical Sympathy in Software Engineering

CPU & GPU - The Basics

OS Error: Too many open files. Understanding file and socket descriptors.