Ahmad W Khanblog.ahmadwkhan.com·Nov 16, 2024Real-Time AI Applications with Open-Source LLMsThe landscape of real-time AI applications has been transformed by open-source Large Language Models (LLMs) like LLaMA, Falcon, and GPT-J. These models, when combined with powerful tools like Hugging Face, LangChain, and Ollama, enable developers to ...Discussllm
Wilbert Aristoblog.wilbertaristo.com·Nov 10, 2024Integrating AI LLM in Rails with OllamaPreface Recently, my team held a 2-day hackathon to find and alleviate some pain points in our product. Developers were free to address these issues with any solutions they thought were suitable. There were no product requirements or UI/UX specificat...Discuss·143 readsollama
Rafal Jackiewiczjackiewicz.hashnode.dev·Oct 27, 2024Training Mistral 7B on a Local Machine with CUDA (RTX 4090)This guide will help you train the Mistral 7B language model on your local machine using CUDA GPU. This guide was tested on a local machine with an RTX 4090, but it should work with GPUs like Tesla T4 that have a minimum of 16 GB of RAM. This guide i...DiscussAI
NovitaAInovita.hashnode.dev·Aug 27, 2024Boost Running with RXT4080: GPU Cloud TipsKey Highlights Introduction of Mixtral: Mixtral is now the most popular free open-source large language model. Problems with running LLM using RTX4080: Insufficient display memory, Slow TTFT, and Huge cost. How to fix these problems: Improve Mixtr...DiscussGPU, NVIDIA, AMD
Arsalan Yaldramyaldram.hashnode.dev·Aug 20, 2024Gen AI for JavaScript Devs: Exploring Open AI Alternatives: Mistral, Llama, and MoreIntroduction: In our previous posts in this series, we explored the OpenAI SDK, in one of the posts we delved into LLM parameters like temperature, top-p, and top-k. We also covered various prompting techniques. In another post, we explored how to ch...Discussgenai
Sam Schneiderblog.samschneider.me·Aug 5, 2024Sassy Food Service Bot. Careful. Few-shot Learning is PowerfulMost AIs are almost annoyingly polite. I wondered how easy it would be to make a chatbot that delights in giving sass to customers. Well, turns out just 3 few-shot learning examples was enough. Don't try this at work kids! First, get set up with a Ju...Discuss·60 readsfew shot learning
Krititechtokwithkriti.hashnode.dev·Aug 4, 2024DocAi - PDFs, Scanned Docs to Structured DataProblem Statement The 'Why' of this AI solution is very important and prevalent across multiple fields. Imagine you have multiple scanned PDF documents: Where customers make some manual selections, add signature/dates/customer information OR You ha...Discuss·1 like·96 readsopenai
Turboline LTDblog.turboline.ai·Jul 10, 2024AI-Based Data Transformation: A Comparison of LLM-Generated PySpark Code (Using Mistral & Google Gemini Advanced)Mistral Le Chat Mistral's Le Chat didn't have the functionality to upload CSV files, so I couldn't generate a transformation code. I could have built a lightweight ingestion process using Mistral API and Langchain. However, that was out of scope for ...Discussgoogle gemini
Kevin Loggenbergblog.thecodesmith.co.za·Jul 9, 2024Local LLM's with .NetIntroduction In this article we will explore performing inference on GGUF models with Llama.cpp using the Llamasharp nuget package. It sounds like it should take longer than it actually does. GGUF models are probably one of the easiest models to work...Discuss·178 readsLlamaSharp
Beau CarnesforfreeCodeCampfreecodecamp.org·Jun 18, 2024Building Intelligent Apps with Mistral AIOpen source LLMs can help you create intelligent apps without having to pay for each API call. We just published a course on the freeCodeCamp.org YouTube channel that will teach you how to use the open source models from Mistral AI to create intellig...DiscussMistralAI
