---
title: "Discussion on \"My Own AI Server Cluster\" | Hashnode"
description: "Discussion on \"My Own AI Server Cluster\". When a16z generously sponsored Dolphin, I had some compute budget, and because the original dolphin-13b was a flop, I had some time to go back to the drawing board. When I was ready to train the next iteration, I reconsidered whether to rent or buy t..."
url: "https://hashnode.com/posts/my-own-ai-server-cluster/65490c32c822876f3a27475a"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [My Own AI Server Cluster](https://erichartford.com/my-own-ai-server-cluster?utm_source=hashnode&utm_medium=feed)

When a16z generously sponsored Dolphin, I had some compute budget, and because the original dolphin-13b was a flop, I had some time to go back to the drawing board. When I was ready to train the next iteration, I reconsidered whether to rent or buy t...

Nov 6, 2023 · 5 min read · erichartford.com  
Updated Dec 6, 2023  
Read the article

-   [#ai](https://hashnode.com/tag/ai)
-   [#mlops](https://hashnode.com/tag/mlops)
-   [#artificial-intelligence](https://hashnode.com/tag/artificial-intelligence)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#machine-learning-models](https://hashnode.com/tag/machine-learning-models)

## Written by

[Eric Hartford](https://hashnode.com/@quixi)

@quixi · Charlotte, North Carolina, USA

  
[View profile](https://hashnode.com/@quixi)

Founder, Quixi AI

I make AI models like Dolphin and Samantha https://ko-fi.com/erichartford BTC 3ENBV6zdwyqieAXzZP2i3EjeZtVwEmAuo4 ETH 0xcac74542A7fF51E2fb03229A5d9D0717cB6d70C9

## Responses 3

Markdown supported · ⌘↵ to post

[Amit Caleechurn](https://hashnode.com/@acaleechurn)

[Jun 25, 2024](https://hashnode.com/posts/my-own-ai-server-cluster/65490c32c822876f3a27475a/comment/667b1d620511da7aabd4619e)

How have the MI100s fared compared to the 4090s? I'm about to build a node and wondering if the ROCM support is mature enough and performs well in comparison to well supported CUDA builds? Are you satisfied with the Gigabyte server after running it for a while, in terms of performance and thermal? You are one of the very few people who have blogged or tried the MI100s, so anything additional you are willing to share is most welcome.

[Martin Vlach](https://hashnode.com/@uHuge)

[Nov 30, 2023](https://hashnode.com/posts/my-own-ai-server-cluster/65490c32c822876f3a27475a/comment/656855ccec8a1d73ade4554f)

What's/'ll be the solution around the faulty nonfunctional VGA output on the second server?

[Eric Hartford](https://hashnode.com/@quixi)

[Nov 30, 2023](https://hashnode.com/posts/my-own-ai-server-cluster/65490c32c822876f3a27475a/comment/656855ccec8a1d73ade4554f#reply-65686ccb1a76142535c59fa3)

I'll put the 4090s on that one, they have video output

[Marshall McLuhan](https://hashnode.com/@MarshallMcLuhan)

[Nov 6, 2023](https://hashnode.com/posts/my-own-ai-server-cluster/65490c32c822876f3a27475a/comment/65494a8c3bfa7ae9e851ed5a)

That is amazing lol. Artisan AI indeed. I look forward to the base model you make along with new Dolphins. So cool 😎 keep up the good work.

[Jay shaw](https://hashnode.com/@Tellview)

[Nov 6, 2023](https://hashnode.com/posts/my-own-ai-server-cluster/65490c32c822876f3a27475a/comment/6549163285211ee764af72f8)

Nice work on your AI servers Eric the configuration sounds great. The original dolphin-13b was a flop! I disagree with you. No I don't think it was a flop. ChatGTP 4.0 is using the Multiple Agent Model in order to to get high performance.

[ts2.space/en/the-use-of-multi-agent-systems-for-a…](https://ts2.space/en/the-use-of-multi-agent-systems-for-achieving-agi-with-chatgpt/)

Your model is running on a completely different architecture. In my opinion you did a nice job.

Jay