AGAndy Gillinai-andy-gill.hashnode.dev·Mar 2, 2025 · 2 min readRemote tmux session on GCP using a Python wrapperWhen experimenting with ML models, I use Google Cloud Platform (GCP) with 24G VRAM GPU. Not great, but better than at home. I set up the GCP such that I can restart from cold to a working model within minuutes. Most of this is scripted via a Makefile...00
AGAndy Gillinai-andy-gill.hashnode.dev·Feb 27, 2025 · 2 min readHaverscript now supports AgentsHaverscript is a lightweight Python library designed for working with Large Language Models (LLMs) and has recently introduced agent functionality in its latest version, 0.3. The library offers a concise, readable syntax for crafting prompts, chainin...00
AGAndy Gillinai-andy-gill.hashnode.dev·Dec 31, 2024 · 3 min readHaverscript 0.2.1 is outHaverscript, a Domain Specific Language designed for building LLM-based agents, continues to evolve with new features and improvements aimed at enhancing its flexibility and usability. With the recent updates, Haverscript has introduced significant c...00
AGAndy Gillinai-andy-gill.hashnode.dev·Dec 23, 2024 · 2 min readHow do you check LLM output for correctness?While doing testing of the together.ai API for haverscript, I came across a problem. Together’s API seem to be ignoring the seed argument. The seed argument provides reproducibility, which is essential for comparing with a golden output. The followin...00
AGAndy Gillinai-andy-gill.hashnode.dev·Dec 17, 2024 · 2 min readSigmoid is Softmax (specialized to 0)Today, I discovered that the sigmoid function is equivalent to softmax when applied to two inputs, with one input fixed to zero. With almost a decade of experience in machine learning, and earlier work in compute for signal processing, I had never co...00