@monotykamary

Developing rapidly with Generative AI

Oct 16, 2024 · 2 min read · Generative AI Generative AI is a subset of artificial intelligence that focuses on creating new content, such as images, text, or audio, based on patterns learned from existing data. Stages for Building LLM-powered Features 1. Identify use cases Th...

LLM tracing in AI system

Oct 16, 2024 · 2 min read · When Building software with Large Language Models (LLMs) involves several steps, from planning to deployment. LLM tracing emerges as a final step in this process, providing ongoing insights and enabling continuous improvement of LLM-powered applicati...

Query Caching for Large Language Models

Oct 16, 2024 · 2 min read · It's quite fascinating to see the increasingly pivotal role that Large Language Models (LLMs) are playing in various applications, covering the spectrum from natural language processing tasks to predictive typing, and more. An undeniable challenge, h...

LLM's Accuracy - Self Refinement

Oct 16, 2024 · 1 min read · Self-refinement is a technique where the model evaluates and refines its own output. Normally, when using an LLM, you provide a prompt and the model generates a completion. With self-refinement, you can instruct the model to review the content it has...

Streamlining Internal Tool Development with Managed LLMOps: A Dify Case Study

Oct 16, 2024 · 4 min read · Organizations are always looking for ways to improve efficiency and productivity. Large Language Models (LLMs) are a powerful technology that can help create smart internal tools. However, using LLMs in existing workflows can be complicated and resou...