---
title: "Discussion on \"How to Set Up a Private OpenAI-Compatible LLM on Google Cloud Run\" | Hashnode"
description: "Discussion on \"How to Set Up a Private OpenAI-Compatible LLM on Google Cloud Run\". For those passionate about privacy and control, the trajectory of improvement in open-weight LLMs and the ecosystem around them has been extremely encouraging:\n\nThe gap in raw reasoning capability between the best OSS models (DeepSeek, Qwen) and the ..."
url: "https://hashnode.com/posts/private-llm-google-cloud/6841c3c4f35f2530f3c660e8"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [How to Set Up a Private OpenAI-Compatible LLM on Google Cloud Run](https://blog.jacobscript.dev/private-llm-google-cloud?utm_source=hashnode&utm_medium=feed)

For those passionate about privacy and control, the trajectory of improvement in open-weight LLMs and the ecosystem around them has been extremely encouraging: The gap in raw reasoning capability between the best OSS models (DeepSeek, Qwen) and the ...

Jun 5, 2025 · 6 min read · blog.jacobscript.dev  
Read the article

-   [#llm](https://hashnode.com/tag/llm)
-   [#apis](https://hashnode.com/tag/apis)
-   [#google-cloud](https://hashnode.com/tag/google-cloud)
-   [#gpu](https://hashnode.com/tag/gpu)
-   [#opensource](https://hashnode.com/tag/opensource)

## Written by

[Jacob Lee](https://hashnode.com/@jacoblee93)

@jacoblee93 · San Francisco, CA, USA

  
[View profile](https://hashnode.com/@jacoblee93)

Maintainer, LangChain.js

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
