---
title: "Discussion on \"Novita.ai LLM Inference Engine: the largest throughput and cheapest inference available\" | Hashnode"
description: "Discussion on \"Novita.ai LLM Inference Engine: the largest throughput and cheapest inference available\". The Novita AI Inference Engine stands out as an exceptionally fast inference service, surpassing all others in terms of speed. It demonstrates impressive performance, processing 130 tokens per second when used with the Llama-2–70B-Chat model, and an ..."
url: "https://hashnode.com/posts/novitaai-llm-inference-engine-the-largest-throughput-and-cheapest-inference-available/661cccf72651a92ef79bd310"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Novita.ai LLM Inference Engine: the largest throughput and cheapest inference available](https://novita.hashnode.dev/novitaai-llm-inference-engine-the-largest-throughput-and-cheapest-inference-available?utm_source=hashnode&utm_medium=feed)

The Novita AI Inference Engine stands out as an exceptionally fast inference service, surpassing all others in terms of speed. It demonstrates impressive performance, processing 130 tokens per second when used with the Llama-2–70B-Chat model, and an ...

Apr 15, 2024 · 4 min read · novita.hashnode.dev  
Read the article

-   [#inference-engine](https://hashnode.com/tag/inference-engine)
-   [#artificial-intelligence](https://hashnode.com/tag/artificial-intelligence)
-   [#stable-diffusion](https://hashnode.com/tag/stable-diffusion)
-   [#llm](https://hashnode.com/tag/llm)

## Written by

[NovitaAI](https://hashnode.com/@NovitaAI)

@NovitaAI

  
[View profile](https://hashnode.com/@NovitaAI)

Deploy AI models effortlessly with our simple API. Build and scale on the most affordable, reliable GPU cloud.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.