Building a Multi-Modal GPT Agent in TypeScript with OpenAI

OpenAI has made building multi-modal APIs a breeze by providing built-in function calling (they call it "tools"). You tell ChatGPT what it can do and what parameters it can use, and then it makes the decision on which tools to call and how to use the...