Ritobroto Sethrito.hashnode.dev·Mar 21, 2024LLM fine-tuning with instruction promptsIf you have ever tried to use the Mistral model from Hugging Face you will be provided with multiple options. Two of the most downloaded options are: Mistral-7B-v0.1 Mistral-7B-Instruct-v0.2 But what is the difference between these 2 models? Mistral-...Discuss·6 likes·26 readsfine-tune
Azizadx azizadx.hashnode.dev·Dec 2, 2023Mastering the FoundationsOverview The goal of the Create Week0 10 Academy-organized Week 0 project is to teach the foundations of data engineering and machine learning. As they go through the Slack Messages Analysis challenge, participants will tackle a variety of Machine Le...Discuss·3 likesAI
Juan Carlos Olamendyjuancolamendy.hashnode.dev·Dec 1, 2023Unlocking the Power of Custom LLMs with LoRA (Low-Rank Adaptation)Introduction Ever felt like taming a giant language model is a bit like wrestling an octopus? Large Language Models (LLMs) represent a breakthrough in AI, but their training can be resource-intensive. Enter LoRA (Low-Rank Adaptation) - your secret sa...DiscussMachine Learning
Saurav Navdharesaurav-navdhare.hashnode.dev·Oct 16, 2023How to fine-tune a Large Language ModelOverview In this blog post, we have explored the concept of tuning Large Language Models (LLMs) and their significance, in the field of Natural Language Processing (NLP). We have discussed why fine-tuning is crucial explaining how it allows us to ada...Discuss·7 likes·52 readsgenerative ai
Mike Youngmikeyoung44.hashnode.dev·Oct 3, 2023Infinite Context Windows? LLMs for Streaming Applications with Attention SinksIn recent years, natural language processing has been revolutionized by the advent of large language models (LLMs). Massive neural networks like GPT-3, PaLM, and BlenderBot have demonstrated remarkable proficiency at various language tasks like conve...DiscussAI
Rohit Saharohitsaha.hashnode.dev·Sep 9, 2023Finetune LLMs via the Finetuning HubHi community, I have been working on benchmarking publicly available LLMs these past couple of weeks. More precisely, I am interested on the finetuning piece since a lot of businesses are starting to entertain the idea of self-hosting LLMs trained on...Discussgenerative ai
Ritobroto Sethrito.hashnode.dev·Sep 9, 2023Fine Tuning vs. RAG (Retrieval-Augmented Generation)There are two approaches to using large language models (LLMs) on our data: Fine-tuning RAG (Retrieval-Augmented Generation) Fine-tuning involves training an LLM on a specific task, such as question answering or summarization, using your data. RA...Discuss·2 likes·448 readsllm
Victor Chabachaba.hashnode.dev·Aug 25, 2023Understanding the Differences:Photo by Boitumelo on Unsplash In the world of machine learning and deep learning, two popular techniques often used to leverage pre-trained models are fine-tuning and transfer learning. These approaches allow us to benefit from the knowledge and exp...DiscussTransfer learning
FHIRFLYfhirfly.hashnode.dev·Aug 22, 2023Fine-tuning ChatGPT: A Comprehensive GuideWhether you're a seasoned AI practitioner or a newcomer eager to harness the capabilities of OpenAI's ChatGPT, fine-tuning is an invaluable tool. This article provides an in-depth guide to understand and implement fine-tuning, allowing you to customi...Discuss·167 readschatgpt
Pranav Joshipranavjoshi.hashnode.dev·Jul 8, 2023Fine-Tuning AI ModelsUnderstanding AI Models and Fine-Tuning Artificial Intelligence AI (Artificial Intelligence) focuses on the creation and development of intelligent machines that can perform tasks that would require human intelligence. AI has numerous applications ac...Discuss·29 likes·192 readsAI