---
title: "Comment by Kartik N V J K on \"Run AI Locally on Your Mac with Ollama: Chat, Tools, RAG and a Custom Model (Real Numbers from a Mac mini M4)\" | Hashnode"
description: "Validation loss bottoming at step 100 (1.382) and climbing to 1.811 by step 300 is the overfitting I keep forgetting to watch for. You kept the step-100 checkpo"
url: "https://hashnode.com/posts/run-ai-locally-on-your-mac-with-ollama-chat-tools-rag-and-a-custom-model-real-numbers-from-a-mac-mini-m4/6ac345cb6485b2d515e70eea/comment/6ac696822e489644295387a1"
---

[Discussion](https://hashnode.com/posts/run-ai-locally-on-your-mac-with-ollama-chat-tools-rag-and-a-custom-model-real-numbers-from-a-mac-mini-m4/6ac345cb6485b2d515e70eea)

Comment [Run AI Locally on Your Mac with Ollama: Chat, Tools, RAG and a Custom Model (Real Numbers from a Mac mini M4)](https://hashnode.com/posts/run-ai-locally-on-your-mac-with-ollama-chat-tools-rag-and-a-custom-model-real-numbers-from-a-mac-mini-m4/6ac345cb6485b2d515e70eea)

[Kartik N V J K](https://hashnode.com/@kartik-nvj)

[Oct 7](https://hashnode.com/posts/run-ai-locally-on-your-mac-with-ollama-chat-tools-rag-and-a-custom-model-real-numbers-from-a-mac-mini-m4/6ac345cb6485b2d515e70eea/comment/6ac696822e489644295387a1)

Validation loss bottoming at step 100 (1.382) and climbing to 1.811 by step 300 is the overfitting I keep forgetting to watch for. You kept the step-100 checkpoint; I once shipped a later one because training loss was still falling while the held-out set had already turned. Did you settle on 300 total steps by watching that curve, or was it a budget set up front?

[RainyTech](https://hashnode.com/@rainytechlab)

[Oct 8](https://hashnode.com/posts/run-ai-locally-on-your-mac-with-ollama-chat-tools-rag-and-a-custom-model-real-numbers-from-a-mac-mini-m4/6ac345cb6485b2d515e70eea/comment/6ac696822e489644295387a1#reply-6ac78156ac88c35424784428)

Honestly, it was a budget I set up front. The command was `--iters 300` with an eval and a checkpoint saved every 100 steps. I only picked the step-100 checkpoint afterwards, once I saw val loss go 1.382 → 1.665 → 1.811 while train loss kept dropping to 0.046.

Looking back, 300 was far too many for the data. It's 108 training examples at batch size 4, so about 27 steps per epoch. 300 steps is roughly 11 passes over the same data, and step 100 is already about 3.7. The validation set is also small (only 12 examples), and I only checked it every 100 steps. So 100 is just the best of the three points I measured, not the actual lowest point. The real minimum could be anywhere from about step 50 to 150.

Next time I'll run eval every 25 steps and stop when val loss stops improving. Thanks for raising it. It's an easy one to miss when the training curve looks so good.
