---
title: "Discussion on \"Deploy a language model (LLM) on AWS Lambda\" | Hashnode"
description: "Discussion on \"Deploy a language model (LLM) on AWS Lambda\". Serverless language model inference using Python, Docker, Lambda, Phi-2 model. A Practical guide."
url: "https://hashnode.com/posts/deploy-a-language-model-llm-on-aws-lambda/6599b199b0c2fdb195fdc370"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Deploy a language model (LLM) on AWS Lambda](https://horosin.com/deploy-a-language-model-llm-on-aws-lambda?utm_source=hashnode&utm_medium=feed)

Serverless language model inference using Python, Docker, Lambda, Phi-2 model. A Practical guide.

Jan 6, 2024 · 13 min read · horosin.com  
Updated Apr 11, 2024  
Read the article

-   [#llm](https://hashnode.com/tag/llm)
-   [#aws](https://hashnode.com/tag/aws)
-   [#docker](https://hashnode.com/tag/docker)
-   [#ai](https://hashnode.com/tag/ai)
-   [#python](https://hashnode.com/tag/python)

## Written by

[Karol Horosin](https://hashnode.com/@horosin)

@horosin

  
[View profile](https://hashnode.com/@horosin)

Software Lead

Engineer, Builder, Writer

## Responses 1

Markdown supported · ⌘↵ to post

[Darryl Ruggles](https://hashnode.com/@darrylr)

[Jan 7, 2024](https://hashnode.com/posts/deploy-a-language-model-llm-on-aws-lambda/6599b199b0c2fdb195fdc370/comment/659b11e25a246ab4fe972821)

A really great idea and article - thanks!

[Karol Horosin](https://hashnode.com/@horosin)

[Jan 7, 2024](https://hashnode.com/posts/deploy-a-language-model-llm-on-aws-lambda/6599b199b0c2fdb195fdc370/comment/659b11e25a246ab4fe972821#reply-659b13c65a246ab4fe97365d)

Thank you 🫡
