My GCP Pipeline Was Running Fine… But Doing Nothing (Service Account Lesson)A real debugging story on how missing IAM permissions in a service account silently broke my Cloud Function, Dataflow trigger, and BigQuery pipeline.4 min read·ankit-data-engineering.hashnode.devMay 2
7 Skills That Make Data Engineering Feel Less HardMost data engineering problems are not what they seem and it took me time to realize what actually matters3 min read·ankit-data-engineering.hashnode.devApr 25
Dataflow Job Not Starting? Debugging a Job Name Collision in GCPDebugging a silent Dataflow failure caused by duplicate job names in a GCS-triggered Cloud Function pipeline4 min read·ankit-data-engineering.hashnode.devApr 18
The Small metadata.json File That Changed How I Work With Image DatasetsA short story about how adding a simple metadata.json file changed the way I organized and analyzed an image dataset collected from multiple cameras.4 min read·ankit-data-engineering.hashnode.devApr 11
When a Cloud Function Keeps Failing and the Code Isn’t the ProblemA small IAM configuration mistake that breaks functions interacting with Storage, Firestore or other services.5 min read·ankit-data-engineering.hashnode.devApr 4