---
title: "Discussion on \"Llama2 From Scratch with Pytorch Lightning\" | Hashnode"
description: "Discussion on \"Llama2 From Scratch with Pytorch Lightning\". Dive into the implementation of Llama2 using PyTorch Lightning.  Extending my Llama implementation to include grouped-query attention."
url: "https://hashnode.com/posts/llama2-from-scratch-with-pytorch-lightning/6542b51c22ec2a1729ee1208"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Llama2 From Scratch with Pytorch Lightning](https://afterhoursresearch.com/llama2-from-scratch-with-pytorch-lightning?utm_source=hashnode&utm_medium=feed)

Dive into the implementation of Llama2 using PyTorch Lightning. Extending my Llama implementation to include grouped-query attention.

Nov 1, 2023 · 7 min read · afterhoursresearch.com  
Read the article

-   [#python](https://hashnode.com/tag/python)
-   [#pytorch](https://hashnode.com/tag/pytorch)
-   [#pytorch-lightning](https://hashnode.com/tag/pytorch-lightning)
-   [#llama2](https://hashnode.com/tag/llama2)
-   [#llm](https://hashnode.com/tag/llm)

## Written by

[After Hours Research](https://hashnode.com/@AfterHoursResearch)

@AfterHoursResearch

  
[View profile](https://hashnode.com/@AfterHoursResearch)

Machine Learning Research - Focusing on LLMs

After work-hours ML Research lab, composed of: Brad &amp; Sara

## Responses

Comments are turned off for this post.
