Sujit Nirmal blackshadow.hashnode.dev·Jul 12, 2024How to Master Decision Trees for Machine Learning ClassificationTopic: Decision Trees for Classification Blog Content: Introduction Welcome back to our journey through the fascinating world of Machine Learning! In our previous blogs, we covered the basics of Machine Learning and delved into Linear Regression. To...Discuss#community healing
RJ Honickylearning-exhaust.hashnode.dev·Jul 12, 2024Can we improve quantization by fine tuning?As a followup to my previous post Are All Large Language Models Really in 1.58 Bits?, I've been wondering if we could apply the same ideas to post-training quantization. The authors trained models from scratch in The Era of 1-bit LLMs: All Large Lang...Discuss·32 readsquantization
Sunil Ghanchisunilghanchi.hashnode.dev·Jul 4, 2024Step-by-Step Guide to Building Datasets for Fine-Tuning Language ModelsBest Practices for Building and Formatting Datasets for Language Model Fine-Tuning Introduction Fine-tuning language models (LLMs) like Llama 3, Google Gemma, and Mistral involves adapting pre-trained models to specific tasks using carefully curated ...Discusshuggingface dataset
Pablo Salvador Lopezpabloaicorner.hashnode.dev·Jul 2, 2024Task Adaptation in Small Language Models: Fine-Tuning Phi-3Small Language Models (SLMs) are gaining popularity due to their efficiency and speed. They are ideal for specialized tasks, especially in projects with limited resources. SLMs offer faster data processing, making them suitable for real-time applicat...Discuss·39 readsAI That Matters: My Take on New Developments 🌟Azure ML
Sunil Ghanchisunilghanchi.hashnode.dev·Jul 2, 2024Maximize Language Model Efficiency: Finetuning with LoRA, PEFT, and MoreIntroduction: The Transformative World of Fine-Tuning In the ever-evolving landscape of artificial intelligence, finetuning pre-trained language models has emerged as a crucial technique to tailor models for specific tasks, optimize performance, and ...DiscussArtificial Intelligence
Aravind M Savd1729.hashnode.dev·Jun 17, 2024Finetuning LLMs : Developing an AI model that can assess newly submitted menus from kitchens.Why finetune LLMs? Why not use them as they are anyway? Wouldn't it save so much effort and time? There isn't one correct answer for this and it depends upon our situation, if the task in our hand is a general one, let's say generating natural langua...Discuss·62 readsllm
RJ Honickylearning-exhaust.hashnode.dev·May 29, 2024A toy problem and a bunch of modelsI have a ton of ideas bouncing around in my head about interesting things to do with or to LLMs and other types of models. I've been using a children's story co-authoring and publishing tool (https://github.com/honicky/story-time and https://www.stor...Discuss·78 readsllm
Nikhil Ikharnik-hil.hashnode.dev·May 26, 2024Demystifying Axolotl Config Files: A Deep Dive into Fine-Tuning TechniquesI wrote a previous post about getting familiar with fine-tuning. I got curious about how this setup could get information about the models and dataset. I checked the GitHub repo and documents so you don't have to. Here is what I learned. I will expla...Discuss·10 likes·112 readsaxolotl
Lukaslukasnotes.dk·May 26, 2024Fine tune Llama 70B using Unsloth, LoRA & Modal as easy as OpenAI ChatGPTIntro I came across Modal last summer when I was on a self-inspired mission to run BLOOM 176B model as an open-source competition to ChatGPT. The guys at modal were amazing and after several days of tinkering after my work, I got it up using 6 GPUs s...Discuss·1 like·30 readsunsloth
Beau CarnesforfreeCodeCampfreecodecamp.org·May 21, 2024Fine-Tuning LLM Models CourseFine-tuning is a process in machine learning that allows you to adapt pre-trained models to specific tasks or datasets, enhancing their performance and usability. We just posted a comprehensive course on the freeCodeCamp.org YouTube channel that will...Discussfinetuning
