GPU Parallelization Isn't Just Moving Code to the GPU

1. The Problem Before getting into GPU parallelization, let's start with the problem that led us there. We had an ML inference workload with a strict end-to-end time requirement. As the amount of data