freelancing and full-time work
6d ago · 4 min read · While working on a GCP Dataflow pipeline for an event-driven ingestion system, I ran into an issue that was surprisingly tricky to debug. Everything looked correct from the outside. Files were landing
Join discussion
Apr 11 · 4 min read · When working with image datasets for machine learning, it is easy to assume that the images themselves are the most important part of the pipeline. At least that is what I thought when I first started
Join discussion
Apr 4 · 5 min read · Recently I was working on a small automation using Google Cloud Functions. The function itself was simple. Whenever a file was uploaded to a Cloud Storage bucket, the function would process that file
Join discussion
Mar 28 · 5 min read · Data pipelines often depend on new data appearing somewhere in the system. In many environments the traditional solution is scheduling: a pipeline runs every hour or every day and checks whether new f
Join discussion
