Continuous learner! Experienced with multiple roles in the retail domain supporting Customer, Marketing and Loyalty teams. Currently lead and build on CDP (Customer Data Platform) Define data quality for pipelines.
Nothing here yet.
Mar 25, 2022 · 1 min read · Treasure data is a leading CDP platform and leverages dig-dag for data pipelines within itself. digdag is similar to airflow where we define tasks inside a dag and is available as an open source. The CDp is a powerful platform but unfortunately no e...
Join discussionMar 22, 2022 · 2 min read · This is a template repo which where I am testing and building solution for automated publishing of my articles/blog posts to dev. It’s just a lot of work to post the same article across places and hence I decided to automate publishing my posts to de...
Join discussion
Aug 9, 2021 · 3 min read · airflow-api-tests This is a collection of Pytest for the 2.0 Stable Rest Apis for Apache Airflow. I have another repo where you could setup airflow locally and play around with these. I am used to RestAssured, but trying out pytest here. Apache Airfl...
Join discussionDec 21, 2020 · 3 min read · I am writing this post to understand how to create a custom LogicalType in Apache Avro. It helps in enforcing strict schema validations for the data in transit as well as rest within their systems. Dividing this into broader sections: Define a schem...
Join discussion
Feb 14, 2020 · 2 min read · A sample json schema A discussion in one of my office meetings, led me to think and write about Json Schema. Every post I write is an attempt to get a better understanding of the topic and keep that as a reference for my future projects. How do you ...
Join discussion