The rising validation loss is the part I'd dig into next. Training loss looks nice, but it doesn't mean much if the model gets worse on unseen cases. I'd try fewer steps and compare the same test set.