When your data collection works fine at small scale but breaks everything at volume

Most data collection projects start the same way. You find a page with the information you need, copy a few rows into a spreadsheet, and move on. It works. Then someone asks for the same data across h