JJayasriinj-jayasri.hashnode.dev·Apr 16, 2025 · 6 min readLLM Pre-Training in GenAIIn this series, we’ll explore everything about pre-training in the Generative AI (GenAI) pipeline — including how models are trained based on specific objectives or goals, and how to design an effective pre-training pipeline. But before diving into ...00
JJayasriinj-jayasri.hashnode.dev·Apr 16, 2025 · 4 min readRAG: 1.BasicsProblems with Generative/FineTuning Approach: Inefficient Data Updates: Adding new data typically requires extensive retraining or fine-tuning, which can be both time-consuming and computationally expensive. Outdated Information: Generative mod...00
JJayasriinj-jayasri.hashnode.dev·Sep 13, 2024 · 2 min readExploring Encoder & Decoder TypesAn Encoder-Decoder is a neural network architecture primarily used in sequence-to-sequence (seq2seq) tasks where input and output sequences can have different lengths. The model consists of two parts: Encoder: Processes the input sequence and compre...00
JJayasriinj-jayasri.hashnode.dev·Aug 28, 2024 · 3 min readGenAI Model Series: BasicsIn this article, we will explore only the basic models required to understand GenAI Comparison Table: ModelWhy It's UsedFeaturesLimitations 1. RNN (Recurrent Neural Network)To handle sequential data by maintaining a hidden state that captur...00
JJayasriinj-jayasri.hashnode.dev·Aug 19, 2024 · 8 min readTokenization Simplified: Part-2This article covers the rest of the tokenization techniques, if you didn't get a chance to see part 1, it is here Types of Tokenization Techniques: Unigram Language Model: It is a probabilistic model that uses individual tokens (subwords or words)...00