8 ms in the Notebook, 4 Seconds in Production: Serving a Model as an API (AI Engineering in 30 Days, Day 4)

A team ships a recommendation model. In the notebook, model.predict(x) returns in 8 milliseconds. They wrap it in a quick Flask app, put it behind a URL, and it works for the first ten users. Then rea