LLM Inference Explained: Runtime, Infrastructure, and ToolingWhen we hear about Generative AI, we often hear about model training, GPUs, LLMs, RAG, agents, and AI applications. But there is another important part that is becoming increasingly important as AI apSep 13 · 10 min readgopalgtm.hashnode.dev
The Ultimate Istio GuideWhat is Istio? Istio is an open-source service mesh that provides a way to control how microservices share data with one another. It offers a platform-agnostic way to secure, connect, and observe microservices. Istio manages communication between ser...Jul 28, 2024 · 7 min readgopalgtm.hashnode.dev
Day 1 - Introduction to Ansible, Ansible Setup, Adoc Command, Playbook🔹What Is Ansible? Ansible is an open-source automation tool that simplifies the management and configuration of systems, applications, and infrastructure. It allows you to automate repetitive tasks, deploy applications, and manage configurations eff...Jun 29, 2024 · 6 min readgopalgtm.hashnode.dev
Api Integration With Apache ApisixWhat is an Apache APISIX? Apache APISIX is a dynamic, high-performance API gateway that is part of the Apache Software Foundation. It is designed to handle API traffic for web, mobile, and IoT applications. APISIX provides advanced features such as d...Apr 14, 2024 · 6 min readgopalgtm.hashnode.dev
Prometheus,Node exporter, Alaert Manager and Grafana SetupInstall Prometheus: Prometheus: Purpose: Prometheus is the core monitoring engine responsible for collecting and storing time-series data (metrics) from various sources. How it Works: It scrapes metrics from instrumented jobs, stores them locally, ...Dec 1, 2023 · 8 min readgopalgtm.hashnode.dev
