Nothing here yet.
Data Engineering Design and Implementation Advisory. Please contact me on Linkedin to discuss your data engineering needs.
Apr 12, 2022 · 5 min read · If you have ever used Airflow, you know that it should exist in a cluster environment. Sure you can run it on one machine with a sequential scheduler, but you are not really taking advantage performance of multiple workers handling multiple if not hu...
Join discussionSep 1, 2021 · 3 min read · If you come from the world of data engineering or if your company ingests and processes large quantities of data on a regular interval basis, you are probably familiar with the Apache Airflow. But did you know there are more things you can do with A...
Join discussionJul 27, 2021 · 4 min read · Does your team or company track the versions of your processed data? If not, maybe one should consider the added value of data versioning. When I use the term "data versioning", what I mean is tracking how your data such as an entity has changed ove...
Join discussionJul 1, 2021 · 1 min read · Like many of us "nerds" out there, we probably have a bucket or three of Legos sitting somewhere. Most of my collectable "Adult" Legos get built once based on the set instructions. However, if you're looking to build something new and interesting wit...
Join discussion