Ben KadishforFractional AI Blogengineering.fractional.ai·Aug 27, 2024Fine Tuning QuirkI was working on content moderation for Change.org (see our full case study here). Our goal was to automatically identify violative content to flag for reviewers. The existing system employed several queries, one of which I found had a high percentag...DiscussAI
Sam Schneiderblog.samschneider.me·Aug 16, 2024A Very Simple Example of Fine-Tuning an LLMNormally when you fine-tune an LLM you end up making Jeff Bezos just a little bit richer due to the enormous compute power required even for the simplest of fine-tuning. I tried every free avenue I could think of to demonstrate fine-tuning using Mist...Discussfinetuning
Abhay Kouloevortex.hashnode.dev·Aug 9, 2024How to Pre-train AI Model with HelpingAI ArchitectureHello, amazing AI enthusiasts! 👋 Ready to embark on an exciting journey of pre-training an AI model using the innovative HelpingAI architecture? Let's dive in! 🌊💻 Step 1: Set Up Your Environment 🛠️ First, let's get everything ready! We'll clone t...Discuss·1 likeAI ML
Sam Schneiderblog.samschneider.me·Aug 7, 2024In a Few Words, What is Few-shot Learning?Imagine that you went to high school in a place where everyone was rich except for you. Your parents had very mediocre jobs, enough to put food on the table and pay for school fees but nothing else. Further imagine that you didn't want anyone else to...Discussfinetuning
Sam Schneiderblog.samschneider.me·Aug 1, 2024Why Would You Ever Fine-tune an LLM?You can get pretty good results with few-shot prompt templates, why would you go to the trouble of spending expensive GPU hours to fine-tune an LLM with essentially the same process as few-shot prompt templates? It basically comes down to data. How m...Discussfinetuning
Debanjan Chakrabortysubspace.hashnode.dev·Jul 28, 2024Understanding Retrieval-Augmented Generation (RAG) and Fine-Tuning Approaches1. Introduction Retrieval-Augmented Generation (RAG) models combine retrieval and generation techniques to improve the accuracy and relevance of generated responses in question-answering contexts. By leveraging both retrieval and generation, RAG mode...DiscussRAG
Sujit Nirmal blackshadow.hashnode.dev·Jul 12, 2024How to Master Decision Trees for Machine Learning ClassificationTopic: Decision Trees for Classification Blog Content: Introduction Welcome back to our journey through the fascinating world of Machine Learning! In our previous blogs, we covered the basics of Machine Learning and delved into Linear Regression. To...Discuss#community healing
RJ Honickylearning-exhaust.hashnode.dev·Jul 12, 2024Can we improve quantization by fine tuning?As a followup to my previous post Are All Large Language Models Really in 1.58 Bits?, I've been wondering if we could apply the same ideas to post-training quantization. The authors trained models from scratch in The Era of 1-bit LLMs: All Large Lang...Discuss·39 readsquantization
Sunil Ghanchisunilghanchi.hashnode.dev·Jul 4, 2024Step-by-Step Guide to Building Datasets for Fine-Tuning Language ModelsBest Practices for Building and Formatting Datasets for Language Model Fine-Tuning Introduction Fine-tuning language models (LLMs) like Llama 3, Google Gemma, and Mistral involves adapting pre-trained models to specific tasks using carefully curated ...Discusshuggingface dataset
Pablo Salvador Lopezpabloaicorner.hashnode.dev·Jul 2, 2024Task Adaptation in Small Language Models: Fine-Tuning Phi-3Small Language Models (SLMs) are gaining popularity due to their efficiency and speed. They are ideal for specialized tasks, especially in projects with limited resources. SLMs offer faster data processing, making them suitable for real-time applicat...Discuss·51 readsAI That Matters🌟Azure ML