Finetune vs Prompt vs Retrieve — When to Use What

Here is the single most common mistake I see teams make when they start building with LLMs. Someone says "the model doesn't know about our stuff." A smart-sounding engineer nods and says "we should fine-tune it on our data." A project gets scoped. A ...