---
title: "Discussion on \"Alright then...adding vLLM to the mix\" | Hashnode"
description: "Discussion on \"Alright then...adding vLLM to the mix\". A few months ago I started using my DGX Spark, and coming in with minimal experience of running local models, I wanted a simple and easy to understand inference engine (as I wrote in this article). Plus I could see the experts on the DGX Spark user g..."
url: "https://hashnode.com/posts/alright-thenaddi/699071da245667f4ca3bbf71"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Alright then...adding vLLM to the mix](https://sparktastic.hashnode.dev/alright-thenaddi?utm_source=hashnode&utm_medium=feed)

A few months ago I started using my DGX Spark, and coming in with minimal experience of running local models, I wanted a simple and easy to understand inference engine (as I wrote in this article). Plus I could see the experts on the DGX Spark user g...

Feb 14 · 4 min read · sparktastic.hashnode.dev  
Read the article

-   [#vllm](https://hashnode.com/tag/vllm)
-   [#local-llm](https://hashnode.com/tag/local-llm)
-   [#dgxspark](https://hashnode.com/tag/dgxspark)

## Written by

[Amegilla](https://hashnode.com/@amegillaAI)

@amegillaAI · London, United Kingdom

  
[View profile](https://hashnode.com/@amegillaAI)

Building things, breaking them, trying again (and again)

Exploring AI in my free time while holding down a job working with startups at one of the Magnificent Seven

## Responses

Markdown supported · ⌘↵ to post

No responses yet.