Google Batch for ad hoc parallelization of large workloads
Recently, I worked on a project that involved processing large volumes of 3D wind data across a long time span. The data was segmented into short intervals, and each interval took 8 to 10 minutes to process on a single-threaded instance. Running the ...
dsblog.hashnode.dev3 min read