Learning Rate Is More Than Just a Number

In the previous article, I tested a reusable experimentation framework with a small learning-rate sweep. Within the range I tried, higher learning rates produced lower validation loss—but the best res