Structuring OpenAI and Gemini Calls in FastAPI: Prompts, Fallbacks, and Retries

The fallback was supposed to be temporary. When the OpenAI API was unavailable, the service would return the last cached result for that user rather than failing the request. Clean degraded experience