---
title: "After Hours Research (@AfterHoursResearch) | Hashnode"
description: "Machine Learning Research - Focusing on LLMs. Read the latest articles by After Hours Research on Hashnode."
url: "https://hashnode.com/@AfterHoursResearch"
---

@AfterHoursResearch

# After Hours Research

@AfterHoursResearch · Joined October 2023

Machine Learning Research - Focusing on LLMs

### [Llama2 From Scratch with Pytorch Lightning](https://afterhoursresearch.com/llama2-from-scratch-with-pytorch-lightning?utm_source=hashnode&utm_medium=feed)

Dive into the implementation of Llama2 using PyTorch Lightning. Extending my Llama implementation to include grouped-query attention.

7 min read · [afterhoursresearch.com](https://afterhoursresearch.com/llama2-from-scratch-with-pytorch-lightning?utm_source=hashnode&utm_medium=feed)

[Nov 1, 2023](https://hashnode.com/posts/llama2-from-scratch-with-pytorch-lightning/6542b51c22ec2a1729ee1208)

### [Llama From Scratch with Pytorch Lightning](https://afterhoursresearch.com/llama-from-scratch-with-pytorch-lightning?utm_source=hashnode&utm_medium=feed)

Explore building Llama from scratch with PyTorch Lightning, Hydra and Wandb. Learn BPE tokenizer, RMSNorm, RoPE and SwiGLU. Includes detailed attention mech

21 min read · [afterhoursresearch.com](https://afterhoursresearch.com/llama-from-scratch-with-pytorch-lightning?utm_source=hashnode&utm_medium=feed)

[Nov 1, 2023](https://hashnode.com/posts/llama-from-scratch-with-pytorch-lightning/65425ac9379eb266bfbbb6ce)

### [Batch Normalization, Layer Normalization and Root Mean Square Layer Normalization: A Comprehensive Guide with Python Implementations](https://afterhoursresearch.com/batch-normalization-layer-normalization-and-root-mean-square-layer-normalization-a-comprehensive-guide-with-python-implementations?utm_source=hashnode&utm_medium=feed)

Understanding BatchNorm, LayerNorm, and RMSNorm: A Deep Dive into Neural Network Normalization Techniques with Python Implementations

6 min read · [afterhoursresearch.com](https://afterhoursresearch.com/batch-normalization-layer-normalization-and-root-mean-square-layer-normalization-a-comprehensive-guide-with-python-implementations?utm_source=hashnode&utm_medium=feed)

[Oct 10, 2023](https://hashnode.com/posts/batch-normalization-layer-normalization-and-root-mean-square-layer-normalization-a-comprehensive-guide-with-python-implementations/6525809f4e4cb0829e6080c7)

### [RoPE - Rotary Positional Embedding](https://afterhoursresearch.com/rope-rotary-positional-embedding?utm_source=hashnode&utm_medium=feed)

Unlock the power of Rotary Positional Embeddings in your NLP models with our comprehensive guide and PyTorch code examples. From theory to implementation, l

5 min read · [afterhoursresearch.com](https://afterhoursresearch.com/rope-rotary-positional-embedding?utm_source=hashnode&utm_medium=feed)

[Oct 4, 2023](https://hashnode.com/posts/rope-rotary-positional-embedding/651d87de3720ec8480bf04fd)
