The distinction between the input and output sides of the pipeline is a great way to frame this. LLMs have made the transformation and structuring of retrieved content much easier, but reliably getting clean data from the web is still a separate engineering problem. I also like the Beautiful Soup vs. Scrapy rule of thumb prototype with the simpler tool, then move to a framework when scheduling, retries, and scale become part of the requirements.