AI, coding and tech explained clearly. Real tutorials with real numbers. New YouTube videos every week.
RainyTech is a YouTube channel by Rainy Reaksmey, a software engineer and mobile developer from Cambodia. Real tutorials, real numbers: local AI on Mac, Python, React and the newest devices. Watch: youtube.com/@RainyTechLab Website: rainytech.dev
Markdown supported · ⌘↵ to post
Ahmet Özel
The step-20 answer dropping authorization is a useful completeness failure, but the displayed comparison question also appears in your training JSONL example. That probe shows how a trained example behaves; it should stay separate from the two genuinely held-out test prompts.
I would choose the checkpoint using a small validation rubric that checks both required concepts, then report untouched test generations only after that choice. Repeatedly reading test answers to pick step 10 would make those prompts part of selection. Keeping these roles explicit would strengthen the smoke test without overstating what twenty examples establish.