How I Reduced the Latency of My SQL AI Assistant from an Average of 40 Seconds to 8 Seconds

Introduction — The Problem I was building a SQL AI Assistant for the live chat flow of a customer chatbot. The goal was simple: instead of manually querying the database, business users could ask ques