Kevin Loggenbergblog.thecodesmith.co.zaยทJul 9, 2024Local LLM's with .NetIntroduction In this article we will explore performing inference on GGUF models with Llama.cpp using the Llamasharp nuget package. It sounds like it should take longer than it actually does. GGUF models are probably one of the easiest models to work...102 readsLlamaSharpAdd a thoughtful commentNo comments yetBe the first to start the conversation.
